Jun 03 01:01:58.827722 np0000002000 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service. Jun 03 01:02:00.301812 np0000002000 nova-compute[98288]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'noop' {{(pid=98288) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jun 03 01:02:00.302501 np0000002000 nova-compute[98288]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'ovs' {{(pid=98288) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jun 03 01:02:00.302501 np0000002000 nova-compute[98288]: INFO os_vif [-] Loaded VIF plugins: noop, ovs Jun 03 01:02:00.421830 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:02:00.431535 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.010s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:02:00.476624 np0000002000 nova-compute[98288]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative Jun 03 01:02:01.194521 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks. Jun 03 01:02:01.194685 np0000002000 nova-compute[98288]: INFO nova.utils [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] The long task thread pool MainProcess.long_task is initialized Jun 03 01:02:01.194961 np0000002000 nova-compute[98288]: INFO nova.virt.driver [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Loading compute driver 'libvirt.LibvirtDriver' Jun 03 01:02:01.383490 np0000002000 nova-compute[98288]: INFO nova.compute.provider_config [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. Jun 03 01:02:01.885595 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Acquiring lock "singleton_lock" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:02:01.885783 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Acquired lock "singleton_lock" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:02:01.885986 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Releasing lock "singleton_lock" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:02:01.886217 np0000002000 nova-compute[98288]: WARNING oslo_service.backend._threading.service [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] no_fork=True: running service in main process Jun 03 01:02:01.886493 np0000002000 nova-compute[98288]: INFO nova.service [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Starting compute node (version 33.1.0) Jun 03 01:02:02.391031 np0000002000 nova-compute[98288]: INFO nova.utils [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] The default thread pool MainProcess.default is initialized Jun 03 01:02:02.391585 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:02:02.391812 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Starting event thread {{(pid=98288) start /opt/stack/nova/nova/virt/libvirt/host.py:251}} Jun 03 01:02:02.392117 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Starting connection event dispatch thread {{(pid=98288) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:552}} Jun 03 01:02:02.392721 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Connecting to libvirt: qemu:///system {{(pid=98288) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:557}} Jun 03 01:02:03.094155 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Registering for lifecycle events {{(pid=98288) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:563}} Jun 03 01:02:03.095359 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Registering for connection events: {{(pid=98288) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:584}} Jun 03 01:02:03.099469 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Connection event '1' reason 'None' Jun 03 01:02:03.599464 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Cannot update service status on host "np0000002000" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000002000 could not be found. Jun 03 01:02:03.599850 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.mount [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Initialising _HostMountState generation 0 {{(pid=98288) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}} Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host capabilities Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: 83c7f1af-554d-4b1b-8e72-d1c6569161d3 Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: x86_64 Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: EPYC-Milan Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: AMD Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: tcp Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: rdma Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.540006 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: 24607192 Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: 6151798 Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: 0 Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: 0 Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.541582 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: apparmor Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: 0 Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: dac Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: 0 Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: +64055:+993 Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: +64055:+993 Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: 64 Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-alpha Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: clipper Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-arm Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: virt-8.2 Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: virt Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: qcom-dc-scm-v1-bmc Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: mori-bmc Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: ast2600-evb Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: borzoi Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: tiogapass-bmc Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: spitz Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: virt-2.7 Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: nuri Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: mcimx7d-sabre Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: romulus-bmc Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: virt-3.0 Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: virt-5.0 Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: npcm750-evb Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: virt-2.10 Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: rainier-bmc Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: mps3-an547 Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: musca-b1 Jun 03 01:02:13.542273 np0000002000 nova-compute[98288]: realview-pbx-a9 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: versatileab Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: kzm Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: virt-2.8 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: fby35-bmc Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: musca-a Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: virt-3.1 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: mcimx6ul-evk Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: virt-5.1 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: smdkc210 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: sx1 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: virt-2.11 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: imx25-pdk Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: stm32vldiscovery Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: virt-2.9 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: orangepi-pc Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: quanta-q71l-bmc Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: z2 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: virt-5.2 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: xilinx-zynq-a9 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: tosa Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: mps2-an500 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: virt-2.12 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: mps2-an521 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: sabrelite Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: mps2-an511 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: canon-a1100 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: realview-eb Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: quanta-gbs-bmc Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: emcraft-sf2 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: realview-pb-a8 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: yosemitev2-bmc Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: virt-7.0 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: virt-4.0 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: raspi1ap Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: palmetto-bmc Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: sx1-v1 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: n810 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: g220a-bmc Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: n800 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: bletchley-bmc Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: virt-7.1 Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: tacoma-bmc Jun 03 01:02:13.543321 np0000002000 nova-compute[98288]: virt-4.1 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: quanta-gsj Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: versatilepb Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: terrier Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: mainstone Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: realview-eb-mpcore Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: integratorcp Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: virt-7.2 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: supermicrox11-bmc Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: virt-4.2 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: witherspoon-bmc Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: qcom-firework-bmc Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: mps3-an524 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: kudo-bmc Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: vexpress-a9 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: midway Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: musicpal Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: lm3s811evb Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: lm3s6965evb Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: supermicro-x11spi-bmc Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: microbit Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: fby35 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: mps2-an505 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: mps2-an385 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: virt-6.0 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: virt-8.0 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: cubieboard Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: ast1030-evb Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: verdex Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: bpim2u Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: netduino2 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: mps2-an386 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: olimex-stm32-h405 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: virt-6.1 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: virt-8.1 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: raspi2b Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: vexpress-a15 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: fuji-bmc Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: virt-6.2 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: sonorapass-bmc Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: cheetah Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: virt-2.6 Jun 03 01:02:13.544199 np0000002000 nova-compute[98288]: ast2500-evb Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: highbank Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: akita Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: connex Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: netduinoplus2 Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: collie Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: raspi0 Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: fp5280g2-bmc Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-arm Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: virt-8.2 Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: virt Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: qcom-dc-scm-v1-bmc Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: mori-bmc Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: ast2600-evb Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: borzoi Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: tiogapass-bmc Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: spitz Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: virt-2.7 Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: nuri Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: mcimx7d-sabre Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: romulus-bmc Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: virt-3.0 Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: virt-5.0 Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: npcm750-evb Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: virt-2.10 Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: rainier-bmc Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: mps3-an547 Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: musca-b1 Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: realview-pbx-a9 Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: versatileab Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: kzm Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: virt-2.8 Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: fby35-bmc Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: musca-a Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: virt-3.1 Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: mcimx6ul-evk Jun 03 01:02:13.545028 np0000002000 nova-compute[98288]: virt-5.1 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: smdkc210 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: sx1 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: virt-2.11 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: imx25-pdk Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: stm32vldiscovery Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: virt-2.9 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: orangepi-pc Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: quanta-q71l-bmc Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: z2 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: virt-5.2 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: xilinx-zynq-a9 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: tosa Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: mps2-an500 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: virt-2.12 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: mps2-an521 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: sabrelite Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: mps2-an511 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: canon-a1100 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: realview-eb Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: quanta-gbs-bmc Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: emcraft-sf2 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: realview-pb-a8 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: yosemitev2-bmc Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: virt-7.0 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: virt-4.0 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: raspi1ap Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: palmetto-bmc Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: sx1-v1 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: n810 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: g220a-bmc Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: n800 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: bletchley-bmc Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: virt-7.1 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: tacoma-bmc Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: virt-4.1 Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: quanta-gsj Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: versatilepb Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: terrier Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: mainstone Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: realview-eb-mpcore Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: integratorcp Jun 03 01:02:13.545922 np0000002000 nova-compute[98288]: virt-7.2 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: supermicrox11-bmc Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: virt-4.2 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: witherspoon-bmc Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: qcom-firework-bmc Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: mps3-an524 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: kudo-bmc Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: vexpress-a9 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: midway Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: musicpal Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: lm3s811evb Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: lm3s6965evb Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: supermicro-x11spi-bmc Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: microbit Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: fby35 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: mps2-an505 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: mps2-an385 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: virt-6.0 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: virt-8.0 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: cubieboard Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: ast1030-evb Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: verdex Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: bpim2u Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: netduino2 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: mps2-an386 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: olimex-stm32-h405 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: virt-6.1 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: virt-8.1 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: raspi2b Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: vexpress-a15 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: fuji-bmc Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: virt-6.2 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: sonorapass-bmc Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: cheetah Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: virt-2.6 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: ast2500-evb Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: highbank Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: akita Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: connex Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: netduinoplus2 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: collie Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: raspi0 Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: fp5280g2-bmc Jun 03 01:02:13.546705 np0000002000 nova-compute[98288]: Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: 64 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-aarch64 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: virt-8.2 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: virt Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: qcom-dc-scm-v1-bmc Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: mori-bmc Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: ast2600-evb Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: borzoi Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: tiogapass-bmc Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: spitz Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: virt-2.7 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: nuri Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: mcimx7d-sabre Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: romulus-bmc Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: virt-3.0 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: virt-5.0 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: npcm750-evb Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: virt-2.10 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: rainier-bmc Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: mps3-an547 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: virt-2.8 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: musca-b1 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: realview-pbx-a9 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: versatileab Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: kzm Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: fby35-bmc Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: musca-a Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: virt-3.1 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: mcimx6ul-evk Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: virt-5.1 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: smdkc210 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: sx1 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: virt-2.11 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: imx25-pdk Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: stm32vldiscovery Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: virt-2.9 Jun 03 01:02:13.547557 np0000002000 nova-compute[98288]: orangepi-pc Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: quanta-q71l-bmc Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: z2 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: virt-5.2 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: xilinx-zynq-a9 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: xlnx-zcu102 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: tosa Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: mps2-an500 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: virt-2.12 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: mps2-an521 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: sabrelite Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: mps2-an511 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: canon-a1100 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: realview-eb Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: quanta-gbs-bmc Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: emcraft-sf2 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: realview-pb-a8 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: sbsa-ref Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: yosemitev2-bmc Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: virt-7.0 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: virt-4.0 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: raspi1ap Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: palmetto-bmc Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: sx1-v1 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: n810 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: g220a-bmc Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: n800 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: bletchley-bmc Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: virt-7.1 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: tacoma-bmc Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: virt-4.1 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: quanta-gsj Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: versatilepb Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: terrier Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: mainstone Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: realview-eb-mpcore Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: integratorcp Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: virt-7.2 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: supermicrox11-bmc Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: virt-4.2 Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: witherspoon-bmc Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: qcom-firework-bmc Jun 03 01:02:13.548383 np0000002000 nova-compute[98288]: mps3-an524 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: kudo-bmc Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: vexpress-a9 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: midway Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: musicpal Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: lm3s811evb Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: lm3s6965evb Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: supermicro-x11spi-bmc Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: microbit Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: fby35 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: mps2-an505 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: mps2-an385 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: virt-6.0 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: virt-8.0 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: raspi3ap Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: cubieboard Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: ast1030-evb Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: verdex Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: bpim2u Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: netduino2 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: xlnx-versal-virt Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: mps2-an386 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: olimex-stm32-h405 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: virt-6.1 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: virt-8.1 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: raspi3b Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: raspi2b Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: vexpress-a15 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: fuji-bmc Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: virt-6.2 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: sonorapass-bmc Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: cheetah Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: virt-2.6 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: ast2500-evb Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: highbank Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: akita Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: connex Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: netduinoplus2 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: collie Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: raspi0 Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: fp5280g2-bmc Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549146 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-cris Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: axis-dev88 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-i386 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-noble-v2 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: ubuntu Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-q35-mantic Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-impish-hpb Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-q35-5.2 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-q35-lunar-hpb Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-mantic Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-2.12 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-2.0 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-xenial Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-q35-kinetic Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-6.2 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-q35-4.2 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-mantic-maxcpus Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-2.5 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-4.2 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-focal Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-hirsute Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-q35-xenial Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-jammy-hpb Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-5.2 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-q35-2.7 Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-q35-eoan-hpb Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-i440fx-disco-hpb Jun 03 01:02:13.549923 np0000002000 nova-compute[98288]: pc-q35-groovy Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-zesty Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-lunar Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-mantic-hpb-maxcpus Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-groovy Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-7.1 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-artful Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-trusty Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-2.2 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-eoan-hpb Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-focal-hpb Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-8.1 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-jammy-maxcpus Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-bionic-hpb Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-mantic-hpb Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-artful Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-8.1 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-2.7 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-6.1 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-kinetic Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-jammy-maxcpus Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-yakkety Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-2.4 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-cosmic-hpb Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-7.1 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-2.10 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: x-remote Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-5.1 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-2.9 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-2.11 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-jammy-hpb-maxcpus Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-3.1 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-6.1 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-4.1 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-jammy Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-2.4 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-i440fx-4.1 Jun 03 01:02:13.550891 np0000002000 nova-compute[98288]: pc-q35-eoan Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-jammy-hpb Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-5.1 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-2.9 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-bionic-hpb Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-lunar Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: isapc Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-mantic-hpb Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-cosmic Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-2.6 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-mantic-maxcpus Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-3.1 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-bionic Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-disco-hpb Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-cosmic Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-2.12 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-bionic Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-kinetic-hpb Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-groovy-hpb Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-7.0 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-noble-v2 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: ubuntu-q35 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-lunar-hpb Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-disco Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-cosmic-hpb Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-noble Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: q35 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-2.1 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-8.0 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-impish Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-wily Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-8.0 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-2.6 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-6.0 Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-impish Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-i440fx-jammy Jun 03 01:02:13.551596 np0000002000 nova-compute[98288]: pc-q35-impish-hpb Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-hirsute Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-4.0.1 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-hirsute-hpb Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-7.0 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-5.0 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-2.8 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-2.10 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-3.0 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-6.0 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-zesty Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-7.2 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-4.0 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-focal Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: microvm Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-2.3 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-jammy-hpb-maxcpus Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-8.2 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: q35 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-kinetic-hpb Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-focal-hpb Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-4.0 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-noble Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-disco Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-groovy-hpb Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-8.2 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-hirsute-hpb Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-5.0 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-6.2 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-2.8 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-eoan Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-2.5 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-3.0 Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-q35-yakkety Jun 03 01:02:13.552256 np0000002000 nova-compute[98288]: pc-i440fx-mantic-hpb-maxcpus Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: pc-i440fx-7.2 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: pc-q35-2.11 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-m68k Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: mcf5208evb Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: virt-7.0 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: an5206 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: virt-6.0 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: q800 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: virt-8.1 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: virt-7.2 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: virt-6.2 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: virt-8.0 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: next-cube Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: virt-7.1 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: virt-6.1 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: virt-8.2 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: virt Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-microblaze Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: petalogix-s3adsp1800 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: petalogix-ml605 Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: xlnx-zynqmp-pmu Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.553503 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-microblazeel Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: petalogix-s3adsp1800 Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: petalogix-ml605 Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: xlnx-zynqmp-pmu Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-mips Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: malta Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: mipssim Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-mipsel Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: malta Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: mipssim Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: 64 Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-mips64 Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: malta Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: mipssim Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: pica61 Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: magnum Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: 64 Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-mips64el Jun 03 01:02:13.554635 np0000002000 nova-compute[98288]: malta Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: loongson3-virt Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: mipssim Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: pica61 Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: magnum Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: boston Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: fuloong2e Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-ppc Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: g3beige Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: amigaone Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: virtex-ml507 Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: mac99 Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: ppce500 Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: sam460ex Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: pegasos2 Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: bamboo Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: 40p Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: ref405ep Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: mpc8544ds Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: 64 Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-ppc64 Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: pseries-noble Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: pseries Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: amigaone Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: powernv9 Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: powernv Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: pseries-4.1 Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: mpc8544ds Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: pseries-6.1 Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: pseries-2.5 Jun 03 01:02:13.555964 np0000002000 nova-compute[98288]: powernv10 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-xenial Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-4.2 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-6.2 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-yakkety Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-2.6 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: ppce500 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-bionic-sxxm Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-2.7 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-3.0 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-8.0 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-5.0 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: 40p Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-lunar Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-2.8 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pegasos2 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-hirsute Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-3.1 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-8.1 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-5.1 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-eoan Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-2.9 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-zesty Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: bamboo Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-groovy Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-focal Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: g3beige Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-8.2 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-5.2 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-disco Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-2.12-sxxm Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-mantic Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-kinetic Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-2.10 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-7.0 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: virtex-ml507 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-2.11 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-2.1 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-7.1 Jun 03 01:02:13.556970 np0000002000 nova-compute[98288]: pseries-cosmic Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-bionic Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-2.12 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-2.2 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-7.2 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: mac99 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-impish Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-jammy Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-artful Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: sam460ex Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: ref405ep Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-2.3 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: powernv8 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-4.0 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-6.0 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-2.4 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: 64 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-ppc64le Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-noble Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: amigaone Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: powernv9 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: powernv Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-4.1 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: mpc8544ds Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-6.1 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-2.5 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: powernv10 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-xenial Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-4.2 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-6.2 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-yakkety Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-2.6 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: ppce500 Jun 03 01:02:13.557687 np0000002000 nova-compute[98288]: pseries-bionic-sxxm Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-2.7 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-3.0 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-8.0 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-5.0 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: 40p Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-lunar Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-2.8 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pegasos2 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-hirsute Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-3.1 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-8.1 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-5.1 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-eoan Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-2.9 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-zesty Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: bamboo Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-groovy Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-focal Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: g3beige Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-8.2 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-5.2 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-disco Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-2.12-sxxm Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-mantic Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-kinetic Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-2.10 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-7.0 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: virtex-ml507 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-2.11 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-2.1 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-7.1 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-cosmic Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-bionic Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-2.12 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-2.2 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-7.2 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: mac99 Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-impish Jun 03 01:02:13.558478 np0000002000 nova-compute[98288]: pseries-jammy Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: pseries-artful Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: sam460ex Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: ref405ep Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: pseries-2.3 Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: powernv8 Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: pseries-4.0 Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: pseries-6.0 Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: pseries-2.4 Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-riscv32 Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: virt Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: spike Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: opentitan Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: sifive_u Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: sifive_e Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: 64 Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-riscv64 Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: virt Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: spike Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: microchip-icicle-kit Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: sifive_u Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: shakti_c Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: sifive_e Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: 64 Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-s390x Jun 03 01:02:13.559205 np0000002000 nova-compute[98288]: s390-ccw-virtio-noble Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-8.0 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-disco Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-6.0 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-2.11 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-7.0 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-mantic Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-xenial Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-5.0 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-focal Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-2.8 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-4.0 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-zesty Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-8.2 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-6.2 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-3.0 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-groovy Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-2.5 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-7.2 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-5.2 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-artful Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-hirsute Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-4.2 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-2.10 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-2.7 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-lunar Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-eoan Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-kinetic Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-8.1 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-yakkety Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-6.1 Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-cosmic Jun 03 01:02:13.560256 np0000002000 nova-compute[98288]: s390-ccw-virtio-bionic Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: s390-ccw-virtio-2.12 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: s390-ccw-virtio-7.1 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: s390-ccw-virtio-2.4 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: s390-ccw-virtio-5.1 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: s390-ccw-virtio-2.9 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: s390-ccw-virtio-impish Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: s390-ccw-virtio-4.1 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: s390-ccw-virtio-jammy Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: s390-ccw-virtio-3.1 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: s390-ccw-virtio-2.6 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-sh4 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: shix Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: r2d Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: 64 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-sh4eb Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: shix Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: r2d Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-sparc Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: SS-5 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: SS-20 Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: LX Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: SPARCClassic Jun 03 01:02:13.560914 np0000002000 nova-compute[98288]: leon3_generic Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: SPARCbook Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: SS-4 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: SS-600MP Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: SS-10 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Voyager Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: 64 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-sparc64 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: sun4u Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: niagara Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: sun4v Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: 64 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-x86_64 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-i440fx-noble-v2 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: ubuntu Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-q35-mantic Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-i440fx-impish-hpb Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-q35-5.2 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-q35-lunar-hpb Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-i440fx-mantic Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-i440fx-2.12 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-i440fx-2.0 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-i440fx-xenial Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-q35-kinetic Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-i440fx-6.2 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-q35-4.2 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-i440fx-mantic-maxcpus Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-i440fx-2.5 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-i440fx-4.2 Jun 03 01:02:13.561983 np0000002000 nova-compute[98288]: pc-i440fx-focal Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-hirsute Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-xenial Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-jammy-hpb Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-5.2 Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-2.7 Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-eoan-hpb Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-zesty Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-groovy Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-disco-hpb Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-lunar Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-mantic-hpb-maxcpus Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-groovy Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-7.1 Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-artful Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-trusty Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-2.2 Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-focal-hpb Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-8.1 Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-eoan-hpb Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-jammy-maxcpus Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-bionic-hpb Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-mantic-hpb Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-artful Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-8.1 Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-2.7 Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-6.1 Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-kinetic Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-jammy-maxcpus Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-yakkety Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-2.4 Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-cosmic-hpb Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-7.1 Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-2.10 Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: x-remote Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-5.1 Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-q35-2.9 Jun 03 01:02:13.563830 np0000002000 nova-compute[98288]: pc-i440fx-2.11 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-jammy-hpb-maxcpus Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-3.1 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-6.1 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-4.1 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-jammy Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-2.4 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-4.1 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-eoan Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-jammy-hpb Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-5.1 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-2.9 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-bionic-hpb Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-lunar Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: isapc Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-mantic-hpb Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-cosmic Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-2.6 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-mantic-maxcpus Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-3.1 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-bionic Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-disco-hpb Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-cosmic Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-2.12 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-bionic Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-kinetic-hpb Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-groovy-hpb Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-7.0 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-noble-v2 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: ubuntu-q35 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-lunar-hpb Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-disco Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-cosmic-hpb Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-i440fx-2.1 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-noble Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: q35 Jun 03 01:02:13.564595 np0000002000 nova-compute[98288]: pc-q35-8.0 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-wily Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-impish Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-8.0 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-2.6 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-6.0 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-impish Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-jammy Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-impish-hpb Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-hirsute Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-4.0.1 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-hirsute-hpb Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-7.0 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-5.0 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-2.8 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-2.10 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-3.0 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-zesty Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-7.2 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-4.0 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-6.0 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-focal Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: microvm Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-2.3 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-jammy-hpb-maxcpus Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-disco Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-kinetic-hpb Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-4.0 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-focal-hpb Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-noble Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-q35-8.2 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: q35 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-groovy-hpb Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-hirsute-hpb Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc-i440fx-8.2 Jun 03 01:02:13.565258 np0000002000 nova-compute[98288]: pc Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: pc-i440fx-5.0 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: pc-i440fx-2.8 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: pc-q35-6.2 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: pc-i440fx-eoan Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: pc-q35-2.5 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: pc-i440fx-3.0 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: pc-q35-yakkety Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: pc-i440fx-mantic-hpb-maxcpus Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: pc-i440fx-7.2 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: pc-q35-2.11 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-xtensa Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: sim Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: kc705 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: ml605 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: ml605-nommu Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: virt Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: lx60-nommu Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: lx200 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: lx200-nommu Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: lx60 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: kc705-nommu Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: hvm Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: 32 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-xtensaeb Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: sim Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: kc705 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: ml605 Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: ml605-nommu Jun 03 01:02:13.565875 np0000002000 nova-compute[98288]: virt Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: lx60-nommu Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: lx200 Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: lx200-nommu Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: lx60 Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: kc705-nommu Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-alpha Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: clipper Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: alpha Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: Jun 03 01:02:13.566818 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.567974 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-arm Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: virt-8.2 Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: armv6l Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.569369 np0000002000 nova-compute[98288]: Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: pxa270-c0 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: cortex-a15 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: pxa270-b0 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: cortex-m4 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: pxa270-a0 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: arm1176 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: pxa270-b1 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: cortex-a7 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: pxa270-a1 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: cortex-a8 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: cortex-r5 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: ti925t Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: cortex-r5f Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: arm1026 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: cortex-a9 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: cortex-m7 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: pxa270 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: pxa260 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: pxa250 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: pxa270-c5 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: pxa261 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: pxa262 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: sa1110 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: cortex-r52 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: sa1100 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: max Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: cortex-m0 Jun 03 01:02:13.570471 np0000002000 nova-compute[98288]: cortex-m33 Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: arm946 Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: pxa255 Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: arm11mpcore Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: cortex-m55 Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: arm926 Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: arm1136 Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: arm1136-r2 Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: cortex-m3 Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.571188 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: 2 Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: 3 Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.572491 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-arm Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: virt-8.2 Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: armv6l Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: pxa270-c0 Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: cortex-a15 Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: pxa270-b0 Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: cortex-m4 Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: pxa270-a0 Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: arm1176 Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: pxa270-b1 Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: cortex-a7 Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: pxa270-a1 Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: cortex-a8 Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: cortex-r5 Jun 03 01:02:13.574335 np0000002000 nova-compute[98288]: ti925t Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: cortex-r5f Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: arm1026 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: cortex-a9 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: cortex-m7 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: pxa270 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: pxa260 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: pxa250 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: pxa270-c5 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: pxa261 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: pxa262 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: sa1110 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: cortex-r52 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: sa1100 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: max Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: cortex-m0 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: cortex-m33 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: arm946 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: pxa255 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: arm11mpcore Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: cortex-m55 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: arm926 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: arm1136 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: arm1136-r2 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: cortex-m3 Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.575505 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: Jun 03 01:02:13.576212 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: 2 Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: 3 Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-arm Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: virt-8.2 Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: armv7l Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: efi Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.577558 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: pxa270-c0 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: cortex-a15 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: pxa270-b0 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: cortex-m4 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: pxa270-a0 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: arm1176 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: pxa270-b1 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: cortex-a7 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: pxa270-a1 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: cortex-a8 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: cortex-r5 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: ti925t Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: cortex-r5f Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: arm1026 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: cortex-a9 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: cortex-m7 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: pxa270 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: pxa260 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: pxa250 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: pxa270-c5 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: pxa261 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: pxa262 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: sa1110 Jun 03 01:02:13.578600 np0000002000 nova-compute[98288]: cortex-r52 Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: sa1100 Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: max Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: cortex-m0 Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: cortex-m33 Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: arm946 Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: pxa255 Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: arm11mpcore Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: cortex-m55 Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: arm926 Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: arm1136 Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: arm1136-r2 Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: cortex-m3 Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.579261 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: 2 Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: 3 Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.581351 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-aarch64 Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: virt-8.2 Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: aarch64 Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: efi Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.ms.fd Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.secboot.fd Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.no-secboot.fd Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: neoverse-n2 Jun 03 01:02:13.582663 np0000002000 nova-compute[98288]: pxa270-c0 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-a15 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: pxa270-b0 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-a57 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-m4 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: pxa270-a0 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: arm1176 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: pxa270-b1 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-a7 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: pxa270-a1 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-a76 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: a64fx Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-a8 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: neoverse-v1 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-r5 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: ti925t Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-r5f Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: arm1026 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-a9 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-m7 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: pxa270 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: pxa260 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: pxa250 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: pxa270-c5 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: pxa261 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: pxa262 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-a710 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: sa1110 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-r52 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: sa1100 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: max Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-a53 Jun 03 01:02:13.583545 np0000002000 nova-compute[98288]: cortex-m0 Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: cortex-m33 Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: cortex-a72 Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: arm946 Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: pxa255 Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: cortex-a55 Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: arm11mpcore Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: cortex-m55 Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: neoverse-n1 Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: arm926 Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: arm1136 Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: cortex-a35 Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: arm1136-r2 Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: cortex-m3 Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.584069 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: Jun 03 01:02:13.585041 np0000002000 nova-compute[98288]: 2 Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: 3 Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-cris Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: axis-dev88 Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: cris Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.586328 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.587339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-i386 Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: pc-q35-noble-v2 Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: i686 Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: AMD Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.588703 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: qemu64 Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: qemu32 Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: phenom Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: pentium3 Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: pentium2 Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: pentium Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: n270 Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: kvm64 Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: kvm32 Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: coreduo Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: core2duo Jun 03 01:02:13.589574 np0000002000 nova-compute[98288]: athlon Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Westmere-IBRS Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Westmere Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Snowridge Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Skylake-Server-noTSX-IBRS Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Skylake-Server-IBRS Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Skylake-Server Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Skylake-Client-noTSX-IBRS Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Skylake-Client-IBRS Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Skylake-Client Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: SapphireRapids Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: SandyBridge-IBRS Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: SandyBridge Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Penryn Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Opteron_G5 Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Opteron_G4 Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Opteron_G3 Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Opteron_G2 Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Opteron_G1 Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Nehalem-IBRS Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: IvyBridge-IBRS Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: IvyBridge Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Icelake-Server-noTSX Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Icelake-Server Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Haswell-noTSX-IBRS Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Haswell-noTSX Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Haswell-IBRS Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: Haswell Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: EPYC-Rome Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: EPYC-Milan Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: EPYC-IBPB Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: EPYC-Genoa Jun 03 01:02:13.591046 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Dhyana Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Cooperlake Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Conroe Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Cascadelake-Server-noTSX Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Cascadelake-Server Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Broadwell-noTSX-IBRS Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Broadwell-noTSX Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Broadwell-IBRS Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Broadwell Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: 486 Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.591658 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: tpm-crb Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.592682 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: relaxed Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: vapic Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: spinlocks Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: vpindex Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: runtime Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: synic Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: stimer Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: reset Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: vendor_id Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: frequencies Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: reenlightenment Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: tlbflush Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: ipi Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: avic Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-i386 Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: pc-i440fx-noble-v2 Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: i686 Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: AMD Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.593944 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: qemu64 Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: qemu32 Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: phenom Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: pentium3 Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: pentium2 Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: pentium Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: n270 Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: kvm64 Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: kvm32 Jun 03 01:02:13.594969 np0000002000 nova-compute[98288]: coreduo Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: core2duo Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: athlon Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Westmere-IBRS Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Westmere Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Snowridge Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Skylake-Server-noTSX-IBRS Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Skylake-Server-IBRS Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Skylake-Server Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Skylake-Client-noTSX-IBRS Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Skylake-Client-IBRS Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Skylake-Client Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: SapphireRapids Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: SandyBridge-IBRS Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: SandyBridge Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Penryn Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Opteron_G5 Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Opteron_G4 Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Opteron_G3 Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Opteron_G2 Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Opteron_G1 Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Nehalem-IBRS Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: IvyBridge-IBRS Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: IvyBridge Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Icelake-Server-noTSX Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Icelake-Server Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Haswell-noTSX-IBRS Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Haswell-noTSX Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Haswell-IBRS Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: Haswell Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: EPYC-Rome Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: EPYC-Milan Jun 03 01:02:13.595790 np0000002000 nova-compute[98288]: EPYC-IBPB Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: EPYC-Genoa Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Dhyana Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Cooperlake Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Conroe Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Cascadelake-Server-noTSX Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Cascadelake-Server Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Broadwell-noTSX-IBRS Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Broadwell-noTSX Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Broadwell-IBRS Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Broadwell Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: 486 Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: ide Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.596430 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: tpm-crb Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.597463 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: relaxed Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: vapic Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: spinlocks Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: vpindex Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: runtime Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: synic Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: stimer Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: reset Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: vendor_id Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: frequencies Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: reenlightenment Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: tlbflush Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: ipi Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: avic Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-i386 Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: pc-q35-noble Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: i686 Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: AMD Jun 03 01:02:13.599503 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: qemu64 Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: qemu32 Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: phenom Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: pentium3 Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: pentium2 Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: pentium Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: n270 Jun 03 01:02:13.600573 np0000002000 nova-compute[98288]: kvm64 Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: kvm32 Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: coreduo Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: core2duo Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: athlon Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Westmere-IBRS Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Westmere Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Snowridge Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Skylake-Server-noTSX-IBRS Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Skylake-Server-IBRS Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Skylake-Server Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Skylake-Client-noTSX-IBRS Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Skylake-Client-IBRS Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Skylake-Client Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: SapphireRapids Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: SandyBridge-IBRS Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: SandyBridge Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Penryn Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Opteron_G5 Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Opteron_G4 Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Opteron_G3 Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Opteron_G2 Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Opteron_G1 Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Nehalem-IBRS Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: IvyBridge-IBRS Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: IvyBridge Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Icelake-Server-noTSX Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Icelake-Server Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Haswell-noTSX-IBRS Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Haswell-noTSX Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Haswell-IBRS Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: Haswell Jun 03 01:02:13.601326 np0000002000 nova-compute[98288]: EPYC-Rome Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: EPYC-Milan Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: EPYC-IBPB Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: EPYC-Genoa Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Dhyana Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Cooperlake Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Conroe Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Cascadelake-Server-noTSX Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Cascadelake-Server Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Broadwell-noTSX-IBRS Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Broadwell-noTSX Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Broadwell-IBRS Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Broadwell Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: 486 Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.601883 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: tpm-crb Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.602927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: relaxed Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: vapic Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: spinlocks Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: vpindex Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: runtime Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: synic Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: stimer Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: reset Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: vendor_id Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: frequencies Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: reenlightenment Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: tlbflush Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: ipi Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: avic Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-i386 Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: pc-i440fx-noble Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: i686 Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.604239 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: AMD Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: qemu64 Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: qemu32 Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: phenom Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: pentium3 Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: pentium2 Jun 03 01:02:13.605288 np0000002000 nova-compute[98288]: pentium Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: n270 Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: kvm64 Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: kvm32 Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: coreduo Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: core2duo Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: athlon Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Westmere-IBRS Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Westmere Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Snowridge Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Skylake-Server-noTSX-IBRS Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Skylake-Server-IBRS Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Skylake-Server Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Skylake-Client-noTSX-IBRS Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Skylake-Client-IBRS Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Skylake-Client Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: SapphireRapids Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: SandyBridge-IBRS Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: SandyBridge Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Penryn Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Opteron_G5 Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Opteron_G4 Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Opteron_G3 Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Opteron_G2 Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Opteron_G1 Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Nehalem-IBRS Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: IvyBridge-IBRS Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: IvyBridge Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Icelake-Server-noTSX Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Icelake-Server Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Haswell-noTSX-IBRS Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Haswell-noTSX Jun 03 01:02:13.606803 np0000002000 nova-compute[98288]: Haswell-IBRS Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Haswell Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: EPYC-Rome Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: EPYC-Milan Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: EPYC-IBPB Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: EPYC-Genoa Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Dhyana Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Cooperlake Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Conroe Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Cascadelake-Server-noTSX Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Cascadelake-Server Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Broadwell-noTSX-IBRS Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Broadwell-noTSX Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Broadwell-IBRS Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Broadwell Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: 486 Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: ide Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.607323 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: tpm-crb Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: Jun 03 01:02:13.608339 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: relaxed Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: vapic Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: spinlocks Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: vpindex Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: runtime Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: synic Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: stimer Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: reset Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: vendor_id Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: frequencies Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: reenlightenment Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: tlbflush Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: ipi Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: avic Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-m68k Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: mcf5208evb Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: m68k Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: Jun 03 01:02:13.609688 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.610709 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-m68k Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: virt-8.2 Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: m68k Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.611975 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.613102 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-microblaze Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: petalogix-s3adsp1800 Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: microblaze Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.615026 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.616063 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-microblazeel Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: petalogix-s3adsp1800 Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: microblazeel Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.617347 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.618425 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-mips Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: malta Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: mips Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.619848 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: ide Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.620790 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-mipsel Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: malta Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: mipsel Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.622939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: ide Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.623966 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-mips64 Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: malta Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: mips64 Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.625170 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: ide Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.626219 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: Jun 03 01:02:13.627958 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-mips64el Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: malta Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: mips64el Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: ide Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.629566 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.630916 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-ppc Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: g3beige Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: ppc Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: Jun 03 01:02:13.632939 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: ide Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: Jun 03 01:02:13.634619 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for ppc64 via machine types: {None, 'pseries', 'powernv'} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-ppc64 Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: pseries-noble Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: ppc64 Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.636727 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: POWER10 Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: POWER9 Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: POWER8 Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: POWER7 Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.639016 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: tpm-spapr Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: spapr-tpm-proxy Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: Jun 03 01:02:13.641296 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-ppc64 Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: pseries-noble Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: ppc64 Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: POWER10 Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: POWER9 Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: POWER8 Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: POWER7 Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: Jun 03 01:02:13.643647 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: tpm-spapr Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: spapr-tpm-proxy Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.645871 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-ppc64 Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: powernv9 Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: ppc64 Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: POWER10 Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: POWER9 Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: POWER8 Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: POWER7 Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.647316 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: Jun 03 01:02:13.648640 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: tpm-spapr Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: spapr-tpm-proxy Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-ppc64le Jun 03 01:02:13.649849 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: pseries-noble Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: ppc64le Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: POWER10 Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: POWER9 Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: POWER8 Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: POWER7 Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.650788 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: tpm-spapr Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: spapr-tpm-proxy Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.651901 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-ppc64le Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: powernv9 Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: ppc64le Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: POWER10 Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: POWER9 Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: POWER8 Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: POWER7 Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.653114 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: tpm-spapr Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: spapr-tpm-proxy Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.654079 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-riscv32 Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: virt Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: riscv32 Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.655259 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.656190 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: Jun 03 01:02:13.657375 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-riscv64 Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: virt Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: riscv64 Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: rv64 Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: sifive-e51 Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: any Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: x-rv128 Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: shakti-c Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: max Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: thead-c906 Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: sifive-u54 Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: veyron-v1 Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.658585 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.659345 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-s390x Jun 03 01:02:13.660547 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: s390-ccw-virtio-noble Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: s390x Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z13 Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z990.3 Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z13-base Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z990.2 Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z196.2-base Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z14 Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z14.2-base Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z990.4 Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z196 Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z10BC.2-base Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z114-base Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: gen16b Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z890.3-base Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: gen16a Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z990.5 Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z196.2 Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: zEC12 Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: zEC12.2 Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z9EC.2 Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z9BC Jun 03 01:02:13.661532 np0000002000 nova-compute[98288]: z9EC.3-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z800-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z14ZR1-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z890 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z990.4-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z9EC.3 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z13.2 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z10BC.2 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: gen15a-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z14.2 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: zBC12-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: gen16a-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z900.3 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z196-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z990 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z14-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z900.2 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z800 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z10EC Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z14ZR1 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z900 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z10EC.2 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z10EC.2-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z900.2-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z900-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z10EC.3 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z990.5-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: max Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: gen15b Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z9BC.2-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: gen15a Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z990.2-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z10EC-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: gen16b-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z114 Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z9EC-base Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: z13s Jun 03 01:02:13.662387 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: gen15b-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: zEC12-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z890.3 Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z10EC.3-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z890.2-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z890.2 Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z10BC-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: zEC12.2-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z890-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z9BC-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z10BC Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z9EC Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z9EC.2-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z13.2-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z900.3-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z990.3-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z13s-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: zBC12 Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z990-base Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: z9BC.2 Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.663042 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.663927 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-sh4 Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: shix Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: sh4 Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: Jun 03 01:02:13.665143 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.666077 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-sh4eb Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: shix Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: sh4eb Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.667315 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.668240 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-sparc Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: SS-5 Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: sparc Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.669456 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.670429 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-sparc64 Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: sun4u Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: sparc64 Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.671700 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: ide Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.672623 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-x86_64 Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: pc-q35-noble-v2 Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: x86_64 Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: efi Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: Jun 03 01:02:13.673817 np0000002000 nova-compute[98288]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: /usr/share/ovmf/OVMF.amdsev.fd Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: AMD Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.674797 np0000002000 nova-compute[98288]: Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: qemu64 Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: qemu32 Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: phenom Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: pentium3 Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: pentium2 Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: pentium Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: n270 Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: kvm64 Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: kvm32 Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: coreduo Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: core2duo Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: athlon Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Westmere-IBRS Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Westmere Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Snowridge Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Skylake-Server-noTSX-IBRS Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Skylake-Server-IBRS Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Skylake-Server Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Skylake-Client-noTSX-IBRS Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Skylake-Client-IBRS Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Skylake-Client Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: SapphireRapids Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: SandyBridge-IBRS Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: SandyBridge Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Penryn Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Opteron_G5 Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Opteron_G4 Jun 03 01:02:13.675726 np0000002000 nova-compute[98288]: Opteron_G3 Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Opteron_G2 Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Opteron_G1 Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Nehalem-IBRS Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: IvyBridge-IBRS Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: IvyBridge Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Icelake-Server-noTSX Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Icelake-Server Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Haswell-noTSX-IBRS Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Haswell-noTSX Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Haswell-IBRS Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Haswell Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: EPYC-Rome Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: EPYC-Milan Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: EPYC-IBPB Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: EPYC-Genoa Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Dhyana Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Cooperlake Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Conroe Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Cascadelake-Server-noTSX Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Cascadelake-Server Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Broadwell-noTSX-IBRS Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Broadwell-noTSX Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Broadwell-IBRS Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Broadwell Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: 486 Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Jun 03 01:02:13.676301 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: tpm-crb Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.677050 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: relaxed Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: vapic Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: spinlocks Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: vpindex Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: runtime Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: synic Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: stimer Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: reset Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: vendor_id Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: frequencies Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: reenlightenment Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: tlbflush Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: ipi Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: avic Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-x86_64 Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: pc-i440fx-noble-v2 Jun 03 01:02:13.678190 np0000002000 nova-compute[98288]: x86_64 Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: efi Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: AMD Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.679287 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: qemu64 Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: qemu32 Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: phenom Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: pentium3 Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: pentium2 Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: pentium Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: n270 Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: kvm64 Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: kvm32 Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: coreduo Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: core2duo Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: athlon Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Westmere-IBRS Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Westmere Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Snowridge Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Skylake-Server-noTSX-IBRS Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Skylake-Server-IBRS Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Skylake-Server Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Skylake-Client-noTSX-IBRS Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Skylake-Client-IBRS Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Skylake-Client Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: SapphireRapids Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: SandyBridge-IBRS Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: SandyBridge Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Penryn Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Opteron_G5 Jun 03 01:02:13.680180 np0000002000 nova-compute[98288]: Opteron_G4 Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Opteron_G3 Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Opteron_G2 Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Opteron_G1 Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Nehalem-IBRS Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: IvyBridge-IBRS Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: IvyBridge Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Icelake-Server-noTSX Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Icelake-Server Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Haswell-noTSX-IBRS Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Haswell-noTSX Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Haswell-IBRS Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Haswell Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: EPYC-Rome Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: EPYC-Milan Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: EPYC-IBPB Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: EPYC-Genoa Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Dhyana Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Cooperlake Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Conroe Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Cascadelake-Server-noTSX Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Cascadelake-Server Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Broadwell-noTSX-IBRS Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Broadwell-noTSX Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Broadwell-IBRS Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Broadwell Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: 486 Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.680834 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: ide Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: Jun 03 01:02:13.681527 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: tpm-crb Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: relaxed Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: vapic Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: spinlocks Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: vpindex Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: runtime Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: synic Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: stimer Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: reset Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: vendor_id Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: frequencies Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: reenlightenment Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: tlbflush Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: ipi Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: avic Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: Jun 03 01:02:13.682660 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-x86_64 Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: pc-q35-noble Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: x86_64 Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: efi Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: /usr/share/ovmf/OVMF.amdsev.fd Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: AMD Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.683751 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: qemu64 Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: qemu32 Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: phenom Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: pentium3 Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: pentium2 Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: pentium Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: n270 Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: kvm64 Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: kvm32 Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: coreduo Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: core2duo Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: athlon Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Westmere-IBRS Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Westmere Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Snowridge Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Skylake-Server-noTSX-IBRS Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Skylake-Server-IBRS Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Skylake-Server Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Skylake-Client-noTSX-IBRS Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Skylake-Client-IBRS Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: Skylake-Client Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: SapphireRapids Jun 03 01:02:13.684644 np0000002000 nova-compute[98288]: SandyBridge-IBRS Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: SandyBridge Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Penryn Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Opteron_G5 Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Opteron_G4 Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Opteron_G3 Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Opteron_G2 Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Opteron_G1 Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Nehalem-IBRS Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: IvyBridge-IBRS Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: IvyBridge Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Icelake-Server-noTSX Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Icelake-Server Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Haswell-noTSX-IBRS Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Haswell-noTSX Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Haswell-IBRS Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Haswell Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: EPYC-Rome Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: EPYC-Milan Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: EPYC-IBPB Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: EPYC-Genoa Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Dhyana Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Cooperlake Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Conroe Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Cascadelake-Server-noTSX Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Cascadelake-Server Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Broadwell-noTSX-IBRS Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Broadwell-noTSX Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Broadwell-IBRS Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Broadwell Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: 486 Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685243 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.685780 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: tpm-crb Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: relaxed Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: vapic Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: spinlocks Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: vpindex Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: runtime Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: synic Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: stimer Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: reset Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: vendor_id Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: frequencies Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: reenlightenment Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: tlbflush Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: ipi Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: avic Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: Jun 03 01:02:13.686968 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-x86_64 Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: pc-i440fx-noble Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: x86_64 Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: efi Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: on Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: off Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: AMD Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688061 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: qemu64 Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: qemu32 Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: phenom Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: pentium3 Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: pentium2 Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: pentium Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: n270 Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: kvm64 Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: kvm32 Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: coreduo Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: core2duo Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: athlon Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Westmere-IBRS Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Westmere Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Snowridge Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Skylake-Server-noTSX-IBRS Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Skylake-Server-IBRS Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Skylake-Server Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Skylake-Client-noTSX-IBRS Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Skylake-Client-IBRS Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: Skylake-Client Jun 03 01:02:13.688977 np0000002000 nova-compute[98288]: SapphireRapids Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: SandyBridge-IBRS Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: SandyBridge Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Penryn Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Opteron_G5 Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Opteron_G4 Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Opteron_G3 Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Opteron_G2 Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Opteron_G1 Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Nehalem-IBRS Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: IvyBridge-IBRS Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: IvyBridge Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Icelake-Server-noTSX Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Icelake-Server Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Haswell-noTSX-IBRS Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Haswell-noTSX Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Haswell-IBRS Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Haswell Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: EPYC-Rome Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: EPYC-Milan Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: EPYC-IBPB Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: EPYC-Genoa Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: EPYC Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Dhyana Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Cooperlake Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Conroe Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Cascadelake-Server-noTSX Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Cascadelake-Server Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Broadwell-noTSX-IBRS Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Broadwell-noTSX Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Broadwell-IBRS Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Broadwell Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: 486 Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Jun 03 01:02:13.689540 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: ide Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.690057 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: tpm-tis Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: tpm-crb Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: passthrough Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: emulator Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: external Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: 1.2 Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: 2.0 Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: relaxed Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: vapic Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: spinlocks Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: vpindex Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: runtime Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: synic Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: stimer Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: reset Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: vendor_id Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: frequencies Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: reenlightenment Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: tlbflush Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: ipi Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: avic Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.691271 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-xtensa Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: sim Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: xtensa Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: Jun 03 01:02:13.692433 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.693535 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-xtensaeb Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: sim Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: xtensaeb Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: rom Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: pflash Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: yes Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: no Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: file Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: anonymous Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: memfd Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.694689 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: disk Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: cdrom Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: floppy Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: lun Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: fdc Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: sata Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: sdl Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: vnc Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: spice Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: egl-headless Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: dbus Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: subsystem Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: default Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: mandatory Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: requisite Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: optional Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: pci Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: scsi Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: virtio-transitional Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: virtio-non-transitional Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: random Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: egd Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: path Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: handle Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: virtiofs Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.695596 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: usb Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: pty Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: unix Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: spicevmc Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: virtio Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: qemu Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: builtin Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: {{(pid=98288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Checking secure boot support for host arch (x86_64) {{(pid=98288) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 03 01:02:13.696822 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Secure Boot support detected Jun 03 01:02:14.149898 np0000002000 nova-compute[98288]: INFO nova.virt.node [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Generated node identity e5e0d48c-b64b-4e03-864c-efd360069abb Jun 03 01:02:14.150147 np0000002000 nova-compute[98288]: INFO nova.virt.node [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Wrote node identity e5e0d48c-b64b-4e03-864c-efd360069abb to /opt/stack/data/nova/compute_id Jun 03 01:02:14.652538 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Compute nodes ['e5e0d48c-b64b-4e03-864c-efd360069abb'] for host np0000002000 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning. Jun 03 01:02:15.655843 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host Jun 03 01:02:16.659823 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] No compute node record found for host np0000002000. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000002000 could not be found. Jun 03 01:02:16.660250 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:02:16.660250 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:02:16.660250 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:02:16.660353 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Auditing locally available compute resources for np0000002000 (node: np0000002000) {{(pid=98288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 03 01:02:16.711582 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:02:16.712320 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:02:16.728186 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] CMD "env LANG=C uptime" returned: 0 in 0.016s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:02:16.728547 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Hypervisor/Node resource view: name=np0000002000 free_ram=16652MB free_disk=75.19065475463867GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 03 01:02:16.728698 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:02:16.728969 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:02:17.231696 np0000002000 nova-compute[98288]: WARNING nova.compute.resource_tracker [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] No compute node record for np0000002000:e5e0d48c-b64b-4e03-864c-efd360069abb: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e5e0d48c-b64b-4e03-864c-efd360069abb could not be found. Jun 03 01:02:17.735732 np0000002000 nova-compute[98288]: INFO nova.compute.resource_tracker [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Compute node record created for np0000002000:np0000002000 with uuid: e5e0d48c-b64b-4e03-864c-efd360069abb Jun 03 01:02:19.242825 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 03 01:02:19.242825 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Final resource view: name=np0000002000 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:02:16 up 25 min, 2 users, load average: 2.69, 1.75, 0.88\n'} {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 03 01:02:19.691424 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] [req-fe97fc5c-4aad-4abd-8e28-8038f1a5bad7] Created resource provider record via placement API for resource provider with UUID e5e0d48c-b64b-4e03-864c-efd360069abb and name np0000002000. Jun 03 01:02:19.742420 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] /sys/module/kvm_amd/parameters/sev contains [N Jun 03 01:02:19.742420 np0000002000 nova-compute[98288]: ] {{(pid=98288) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2037}} Jun 03 01:02:19.742621 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.host [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] kernel doesn't support AMD SEV Jun 03 01:02:19.742846 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:02:19.743054 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Updating inventory in ProviderTree for provider e5e0d48c-b64b-4e03-864c-efd360069abb with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 03 01:02:19.743370 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:02:19.749342 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Libvirt baseline CPU Jun 03 01:02:19.749342 np0000002000 nova-compute[98288]: x86_64 Jun 03 01:02:19.749342 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:02:19.749342 np0000002000 nova-compute[98288]: AMD Jun 03 01:02:19.749342 np0000002000 nova-compute[98288]: Jun 03 01:02:19.749342 np0000002000 nova-compute[98288]: Jun 03 01:02:19.749342 np0000002000 nova-compute[98288]: Jun 03 01:02:19.749342 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}} Jun 03 01:02:20.314359 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Updated inventory for provider e5e0d48c-b64b-4e03-864c-efd360069abb with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}} Jun 03 01:02:20.314814 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Updating resource provider e5e0d48c-b64b-4e03-864c-efd360069abb generation from 0 to 1 during operation: update_inventory {{(pid=98288) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jun 03 01:02:20.314814 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Updating inventory in ProviderTree for provider e5e0d48c-b64b-4e03-864c-efd360069abb with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 03 01:02:20.442951 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Updating resource provider e5e0d48c-b64b-4e03-864c-efd360069abb generation from 1 to 2 during operation: update_traits {{(pid=98288) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jun 03 01:02:20.949723 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Compute_service record updated for np0000002000:np0000002000 {{(pid=98288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 03 01:02:20.949979 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.221s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:02:20.950045 np0000002000 nova-compute[98288]: DEBUG nova.service [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98288) start /opt/stack/nova/nova/service.py:195}} Jun 03 01:02:20.967708 np0000002000 nova-compute[98288]: DEBUG nova.service [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98288) start /opt/stack/nova/nova/service.py:211}} Jun 03 01:02:20.984584 np0000002000 nova-compute[98288]: DEBUG nova.service [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] Join ServiceGroup membership for this service compute {{(pid=98288) start /opt/stack/nova/nova/service.py:221}} Jun 03 01:02:20.984796 np0000002000 nova-compute[98288]: DEBUG nova.servicegroup.drivers.db [None req-d1a7c84b-5e78-4f20-a881-b0e096ef00c9 None None] DB_Driver: join new ServiceGroup member np0000002000 to the compute group, service = {{(pid=98288) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jun 03 01:02:26.488408 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:02:34.986560 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:02:35.489316 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:02:35.489934 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 24.99 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:03:00.477622 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:03:00.478169 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:03:00.478271 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:03:00.478494 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:03:00.478707 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:03:00.478930 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:03:00.479334 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:03:00.479334 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 03 01:03:00.479562 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:03:00.982824 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:03:00.983302 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:03:00.983454 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:03:00.983579 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Auditing locally available compute resources for np0000002000 (node: np0000002000) {{(pid=98288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 03 01:03:00.990727 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:03:00.991452 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:03:01.003407 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "env LANG=C uptime" returned: 0 in 0.012s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:03:01.003964 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Hypervisor/Node resource view: name=np0000002000 free_ram=16437MB free_disk=75.05652236938477GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 03 01:03:01.004628 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:03:01.004852 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:03:02.053458 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 03 01:03:02.053458 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Final resource view: name=np0000002000 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:03:01 up 26 min, 2 users, load average: 1.80, 1.64, 0.89\n'} {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 03 01:03:02.094501 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:03:02.094501 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:03:02.596942 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:03:03.102644 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Compute_service record updated for np0000002000:np0000002000 {{(pid=98288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 03 01:03:03.103019 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.098s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:03:03.103051 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:04:03.097110 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:04:03.097596 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:04:03.097596 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:04:03.097727 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:04:03.097882 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:04:03.098049 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:04:03.098208 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:04:03.098379 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:04:03.098526 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 03 01:04:03.098692 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:04:03.601855 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:03.602078 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:03.602154 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:03.602245 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Auditing locally available compute resources for np0000002000 (node: np0000002000) {{(pid=98288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 03 01:04:03.636543 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:04:03.637264 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:03.649095 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "env LANG=C uptime" returned: 0 in 0.012s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:03.649541 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Hypervisor/Node resource view: name=np0000002000 free_ram=16392MB free_disk=74.85261154174805GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 03 01:04:03.649667 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:03.649925 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:04.700822 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 03 01:04:04.701196 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Final resource view: name=np0000002000 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:04:03 up 27 min, 2 users, load average: 1.28, 1.51, 0.90\n'} {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 03 01:04:04.741681 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:04:04.741922 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:04:05.244229 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:04:05.750273 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Compute_service record updated for np0000002000:np0000002000 {{(pid=98288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 03 01:04:05.750729 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.101s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:05.750729 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:04:26.491037 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:04:33.393400 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "51db6d36-20a9-4490-9210-1469eae21d03" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:33.396458 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "51db6d36-20a9-4490-9210-1469eae21d03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:33.396458 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:33.396458 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:33.901945 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:04:33.916634 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:04:34.466966 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:34.467307 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:34.470651 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:04:34.470927 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Claim successful on node np0000002000 Jun 03 01:04:34.492708 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:35.649648 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:04:35.649990 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:04:36.153468 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:04:36.659656 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.192s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:36.660205 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:04:36.662471 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.171s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:36.678562 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:04:36.678562 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Claim successful on node np0000002000 Jun 03 01:04:37.169544 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:04:37.169544 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:04:37.169734 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:37.171197 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:37.675558 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:04:37.788535 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:37.788754 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:37.903714 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:04:37.903969 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:04:38.178190 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:04:38.290512 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:04:38.406976 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:04:38.509658 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '978123ec500f4f60a735f0f3c59dbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458b2c2a365c46d6adcc9f193597a08a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:04:38.836897 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:38.915151 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.253s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:38.915672 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.079s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:38.915869 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:04:38.919592 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:04:38.919720 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Claim successful on node np0000002000 Jun 03 01:04:39.186331 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:04:39.187710 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:04:39.187905 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Creating image(s) Jun 03 01:04:39.188455 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "/opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:39.188696 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "/opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:39.189178 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "/opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:39.189877 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:39.190092 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:39.427160 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:04:39.427160 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:04:39.441509 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:39.441964 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:39.545669 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:39.548053 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:39.548847 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7.part --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:39.619269 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7.part --force-share --output=json" returned: 0 in 0.071s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:39.619935 np0000002000 nova-compute[98288]: DEBUG nova.virt.images [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] 19d2b67c-d393-46ed-9253-ee20621e0ff0 was qcow2, converting to raw {{(pid=98288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 03 01:04:39.620639 np0000002000 nova-compute[98288]: DEBUG nova.privsep.utils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 03 01:04:39.620907 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7.part /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7.converted {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:39.842387 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7.part /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7.converted" returned: 0 in 0.221s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:39.847303 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7.converted --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:39.904979 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7.converted --force-share --output=json" returned: 0 in 0.057s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:39.905671 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.716s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:39.907989 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:39.910497 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:39.911217 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7vnxojuw/privsep.sock'] Jun 03 01:04:39.921929 np0000002000 sudo[109471]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7vnxojuw/privsep.sock Jun 03 01:04:39.922636 np0000002000 sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 03 01:04:39.950252 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:04:40.069647 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a5f52b75bd44cd880fcd26870d24190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b5c165c8b142b6af1c20eeac918eb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:04:40.150071 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:04:40.150247 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:04:40.153857 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 03 01:04:40.153932 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 03 01:04:40.153996 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 03 01:04:40.154053 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Jun 03 01:04:40.154103 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 03 01:04:40.154149 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 03 01:04:40.154196 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 03 01:04:40.154249 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Jun 03 01:04:40.154297 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 03 01:04:40.449034 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 03 01:04:40.449152 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 03 01:04:40.449152 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 03 01:04:40.449152 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Jun 03 01:04:40.449309 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 03 01:04:40.449309 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 03 01:04:40.449309 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 03 01:04:40.449309 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Jun 03 01:04:40.449465 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 03 01:04:40.457049 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:04:40.657472 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:04:40.675745 np0000002000 sudo[109471]: pam_unix(sudo:session): session closed for user root Jun 03 01:04:40.677949 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Spawned new privsep daemon via rootwrap Jun 03 01:04:40.678464 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 03 01:04:40.678597 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 03 01:04:40.678698 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 03 01:04:40.678782 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109477 Jun 03 01:04:40.762669 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:40.822532 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.060s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:40.822911 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:40.823379 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:40.823988 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:40.826765 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:40.827102 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:40.892612 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.065s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:40.893145 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:40.924348 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk 1073741824" returned: 0 in 0.031s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:40.925152 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.101s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:40.925277 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:40.993785 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.068s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:40.994177 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:04:40.994432 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:41.055668 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk --force-share --output=json" returned: 0 in 0.061s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:41.056158 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Cannot resize image /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:04:41.056899 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:04:41.057153 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Ensure instance console log exists: /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:04:41.057512 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:41.057791 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:41.057977 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:41.155196 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Successfully created port: 99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:04:41.168907 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.253s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:41.173616 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:04:41.470091 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:04:41.471164 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:04:41.471402 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Creating image(s) Jun 03 01:04:41.473642 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "/opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:41.473955 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "/opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:41.474200 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "/opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:41.474774 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:41.478949 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:41.480285 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:41.546101 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.065s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:41.546527 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:41.546971 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:41.547375 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:41.550007 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:41.550065 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:41.602922 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.052s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:41.603341 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:41.638037 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk 1073741824" returned: 0 in 0.034s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:41.638504 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.091s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:41.638874 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:41.680601 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:04:41.680785 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:04:41.681191 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:41.681495 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:41.695269 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.056s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:41.695707 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:04:41.696138 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:41.756611 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json" returned: 0 in 0.060s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:41.757418 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Cannot resize image /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:04:41.757682 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:04:41.758459 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Ensure instance console log exists: /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:04:41.758459 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:41.759818 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:41.759818 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:41.803329 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Successfully created port: 1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:04:42.185333 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:04:42.423349 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Successfully updated port: 99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:04:42.428649 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a95a67614fa2443596fde71d819153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64016d71af32442f8c9e0e2fc40a542b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:04:42.627072 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Acquiring lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:42.627230 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:42.689937 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:04:42.930884 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "refresh_cache-51db6d36-20a9-4490-9210-1469eae21d03" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:42.931014 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquired lock "refresh_cache-51db6d36-20a9-4490-9210-1469eae21d03" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:42.931143 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:04:42.999509 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Successfully updated port: 1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:04:43.036379 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Successfully created port: 9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:04:43.056245 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-f3884c50-b328-4f95-b074-e416883eebdd req-e5f1d9b6-1892-4279-be65-717f82c01750 service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Received event network-changed-99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:43.056475 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-f3884c50-b328-4f95-b074-e416883eebdd req-e5f1d9b6-1892-4279-be65-717f82c01750 service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Refreshing instance network info cache due to event network-changed-99d6fecc-d026-4678-99ce-d8303121f361. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:04:43.056532 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-f3884c50-b328-4f95-b074-e416883eebdd req-e5f1d9b6-1892-4279-be65-717f82c01750 service nova] Acquiring lock "refresh_cache-51db6d36-20a9-4490-9210-1469eae21d03" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:43.129175 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:04:43.501169 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "refresh_cache-4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:43.501506 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquired lock "refresh_cache-4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:43.501506 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:04:43.531903 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Successfully updated port: 9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:04:43.603273 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:04:43.700769 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:04:43.703394 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:43.703505 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:43.704405 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:04:43.704405 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Creating image(s) Jun 03 01:04:43.706289 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:04:43.706960 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Claim successful on node np0000002000 Jun 03 01:04:43.708431 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "/opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:43.709085 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "/opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:43.709576 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "/opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:43.710078 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:43.713204 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:43.715093 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:43.781381 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.066s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:43.781677 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:43.782541 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:43.782877 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:43.788459 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:43.788459 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:43.867862 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.080s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:43.868407 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:43.903818 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk 1073741824" returned: 0 in 0.035s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:43.906463 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.122s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:43.906463 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:43.973578 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.068s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:43.974362 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:04:43.974845 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:44.034127 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json" returned: 0 in 0.059s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:44.035395 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:44.039022 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Cannot resize image /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:04:44.039140 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquired lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:44.039285 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:04:44.040985 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:04:44.040985 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Ensure instance console log exists: /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:04:44.041533 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:44.041792 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:44.042020 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:44.316673 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:04:44.407693 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:44.635132 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:04:44.683806 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Updating instance_info_cache with network_info: [{"id": "99d6fecc-d026-4678-99ce-d8303121f361", "address": "fa:16:3e:b8:bd:73", "network": {"id": "103b91e1-d9d9-478b-9498-4552e42f3160", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106681336-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "458b2c2a365c46d6adcc9f193597a08a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d6fecc-d0", "ovs_interfaceid": "99d6fecc-d026-4678-99ce-d8303121f361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:44.710111 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:44.732462 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4ead5870-3260-4224-a2d2-9307b86fb5d0 req-39377c28-b925-481b-9bd4-df07d16d7b7a service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-changed-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:44.732674 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4ead5870-3260-4224-a2d2-9307b86fb5d0 req-39377c28-b925-481b-9bd4-df07d16d7b7a service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Refreshing instance network info cache due to event network-changed-9055a094-dc81-45da-9637-48b820c58772. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:04:44.732897 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4ead5870-3260-4224-a2d2-9307b86fb5d0 req-39377c28-b925-481b-9bd4-df07d16d7b7a service nova] Acquiring lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:44.777329 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:44.777580 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:44.902451 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:44.935925 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Updating instance_info_cache with network_info: [{"id": "1d295ed9-260a-4fd7-a169-b87add358744", "address": "fa:16:3e:b8:08:22", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d295ed9-26", "ovs_interfaceid": "1d295ed9-260a-4fd7-a169-b87add358744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:45.089300 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updating instance_info_cache with network_info: [{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:45.095484 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:04:45.096142 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:04:45.156630 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b0593697-7645-4a82-951a-076f6674c082 req-6919817a-ab72-4a6e-91de-63e5db086bf4 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Received event network-changed-1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:45.156948 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b0593697-7645-4a82-951a-076f6674c082 req-6919817a-ab72-4a6e-91de-63e5db086bf4 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Refreshing instance network info cache due to event network-changed-1d295ed9-260a-4fd7-a169-b87add358744. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:04:45.156948 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b0593697-7645-4a82-951a-076f6674c082 req-6919817a-ab72-4a6e-91de-63e5db086bf4 service nova] Acquiring lock "refresh_cache-4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:45.188154 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Releasing lock "refresh_cache-51db6d36-20a9-4490-9210-1469eae21d03" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:45.188461 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Instance network_info: |[{"id": "99d6fecc-d026-4678-99ce-d8303121f361", "address": "fa:16:3e:b8:bd:73", "network": {"id": "103b91e1-d9d9-478b-9498-4552e42f3160", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106681336-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "458b2c2a365c46d6adcc9f193597a08a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d6fecc-d0", "ovs_interfaceid": "99d6fecc-d026-4678-99ce-d8303121f361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:04:45.188936 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-f3884c50-b328-4f95-b074-e416883eebdd req-e5f1d9b6-1892-4279-be65-717f82c01750 service nova] Acquired lock "refresh_cache-51db6d36-20a9-4490-9210-1469eae21d03" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:45.191461 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Start _get_guest_xml network_info=[{"id": "99d6fecc-d026-4678-99ce-d8303121f361", "address": "fa:16:3e:b8:bd:73", "network": {"id": "103b91e1-d9d9-478b-9498-4552e42f3160", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106681336-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "458b2c2a365c46d6adcc9f193597a08a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d6fecc-d0", "ovs_interfaceid": "99d6fecc-d026-4678-99ce-d8303121f361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:04:45.191837 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-f3884c50-b328-4f95-b074-e416883eebdd req-e5f1d9b6-1892-4279-be65-717f82c01750 service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Refreshing network info cache for port 99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:04:45.194810 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:04:45.199433 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-671409409', uuid='51db6d36-20a9-4490-9210-1469eae21d03'), owner=OwnerMeta(userid='978123ec500f4f60a735f0f3c59dbf8e', username='tempest-DeleteServersTestJSON-1608594473-project-member', projectid='458b2c2a365c46d6adcc9f193597a08a', projectname='tempest-DeleteServersTestJSON-1608594473'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "99d6fecc-d026-4678-99ce-d8303121f361", "address": "fa:16:3e:b8:bd:73", "network": {"id": "103b91e1-d9d9-478b-9498-4552e42f3160", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106681336-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "458b2c2a365c46d6adcc9f193597a08a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d6fecc-d0", "ovs_interfaceid": "99d6fecc-d026-4678-99ce-d8303121f361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448685.1982324) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:04:45.200696 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:04:45.200786 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:04:45.201762 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:04:45.202002 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:04:45.204200 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:04:45.204694 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:04:45.204922 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:04:45.205510 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:04:45.205600 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:04:45.205753 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:04:45.205928 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:04:45.206173 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:04:45.206417 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:04:45.206793 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:04:45.206982 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:04:45.207193 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:04:45.222089 np0000002000 nova-compute[98288]: DEBUG nova.privsep.utils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 03 01:04:45.223243 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-671409409',display_name='tempest-DeleteServersTestJSON-server-671409409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-deleteserverstestjson-server-671409409',id=1,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='458b2c2a365c46d6adcc9f193597a08a',ramdisk_id='',reservation_id='r-zqjfvnky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1608594473',owner_user_name='tempest-DeleteServersTestJSON-1608594473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:38Z,user_data=None,user_id='978123ec500f4f60a735f0f3c59dbf8e',uuid=51db6d36-20a9-4490-9210-1469eae21d03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99d6fecc-d026-4678-99ce-d8303121f361", "address": "fa:16:3e:b8:bd:73", "network": {"id": "103b91e1-d9d9-478b-9498-4552e42f3160", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106681336-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "458b2c2a365c46d6adcc9f193597a08a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d6fecc-d0", "ovs_interfaceid": "99d6fecc-d026-4678-99ce-d8303121f361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:04:45.224479 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Converting VIF {"id": "99d6fecc-d026-4678-99ce-d8303121f361", "address": "fa:16:3e:b8:bd:73", "network": {"id": "103b91e1-d9d9-478b-9498-4552e42f3160", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106681336-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "458b2c2a365c46d6adcc9f193597a08a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d6fecc-d0", "ovs_interfaceid": "99d6fecc-d026-4678-99ce-d8303121f361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:45.224960 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:bd:73,bridge_name='br-int',has_traffic_filtering=True,id=99d6fecc-d026-4678-99ce-d8303121f361,network=Network(103b91e1-d9d9-478b-9498-4552e42f3160),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d6fecc-d0') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:45.226303 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lazy-loading 'pci_devices' on Instance uuid 51db6d36-20a9-4490-9210-1469eae21d03 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:04:45.279655 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:04:45.438294 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Releasing lock "refresh_cache-4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:45.438294 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Instance network_info: |[{"id": "1d295ed9-260a-4fd7-a169-b87add358744", "address": "fa:16:3e:b8:08:22", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d295ed9-26", "ovs_interfaceid": "1d295ed9-260a-4fd7-a169-b87add358744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:04:45.440786 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Start _get_guest_xml network_info=[{"id": "1d295ed9-260a-4fd7-a169-b87add358744", "address": "fa:16:3e:b8:08:22", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d295ed9-26", "ovs_interfaceid": "1d295ed9-260a-4fd7-a169-b87add358744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:04:45.440786 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b0593697-7645-4a82-951a-076f6674c082 req-6919817a-ab72-4a6e-91de-63e5db086bf4 service nova] Acquired lock "refresh_cache-4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:45.440786 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-b0593697-7645-4a82-951a-076f6674c082 req-6919817a-ab72-4a6e-91de-63e5db086bf4 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Refreshing network info cache for port 1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:04:45.443041 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:04:45.444332 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-205644783', uuid='4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff'), owner=OwnerMeta(userid='6a5f52b75bd44cd880fcd26870d24190', username='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member', projectid='e3b5c165c8b142b6af1c20eeac918eb0', projectname='tempest-ServerBootFromVolumeStableRescueTest-1020364370'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1d295ed9-260a-4fd7-a169-b87add358744", "address": "fa:16:3e:b8:08:22", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d295ed9-26", "ovs_interfaceid": "1d295ed9-260a-4fd7-a169-b87add358744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448685.4438581) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:04:45.445256 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:04:45.445622 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:04:45.447618 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:04:45.447841 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:04:45.448579 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:04:45.448900 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:04:45.449424 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:04:45.449424 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:04:45.449424 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:04:45.449640 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:04:45.449803 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:04:45.450500 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:04:45.450500 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:04:45.450500 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:04:45.450500 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:04:45.450849 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:04:45.466585 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-205644783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-205644783',id=2,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-tga00ogs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:40Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d295ed9-260a-4fd7-a169-b87add358744", "address": "fa:16:3e:b8:08:22", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d295ed9-26", "ovs_interfaceid": "1d295ed9-260a-4fd7-a169-b87add358744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:04:45.466815 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "1d295ed9-260a-4fd7-a169-b87add358744", "address": "fa:16:3e:b8:08:22", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d295ed9-26", "ovs_interfaceid": "1d295ed9-260a-4fd7-a169-b87add358744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:45.467518 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:08:22,bridge_name='br-int',has_traffic_filtering=True,id=1d295ed9-260a-4fd7-a169-b87add358744,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d295ed9-26') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:45.468098 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'pci_devices' on Instance uuid 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:04:45.593048 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Releasing lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:45.593313 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Instance network_info: |[{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:04:45.593768 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4ead5870-3260-4224-a2d2-9307b86fb5d0 req-39377c28-b925-481b-9bd4-df07d16d7b7a service nova] Acquired lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:45.597895 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-4ead5870-3260-4224-a2d2-9307b86fb5d0 req-39377c28-b925-481b-9bd4-df07d16d7b7a service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Refreshing network info cache for port 9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:04:45.597895 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Start _get_guest_xml network_info=[{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:04:45.597895 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:04:45.602263 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:04:45.603122 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-690499922', uuid='1225d1ad-70c5-43e1-b8f0-927efb3ef6be'), owner=OwnerMeta(userid='a95a67614fa2443596fde71d819153e7', username='tempest-ServerActionsTestOtherB-1369156437-project-member', projectid='64016d71af32442f8c9e0e2fc40a542b', projectname='tempest-ServerActionsTestOtherB-1369156437'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448685.6028757) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:04:45.603934 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:04:45.605558 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:04:45.608545 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:04:45.608545 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:04:45.608545 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:04:45.608713 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:04:45.608885 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:04:45.609484 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:04:45.609484 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:04:45.609484 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:04:45.609484 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:04:45.609767 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:04:45.609767 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:04:45.609906 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:04:45.610072 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:04:45.610240 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:04:45.624774 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-690499922',display_name='tempest-ServerActionsTestOtherB-server-690499922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serveractionstestotherb-server-690499922',id=3,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+EmDDwoR2OvmMWSLRL3pD12IuhLKXYlFCyFD0S6tz1U811/Ppz6LfRqvK84OL/tJp7AFM3OOYK27W8pAe9Ufj1wNI9CICCs+j8JCdUBCkwgtBDQJU6o6T6RKxEkHfeyw==',key_name='tempest-keypair-122608129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64016d71af32442f8c9e0e2fc40a542b',ramdisk_id='',reservation_id='r-mvqoecge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1369156437',owner_user_name='tempest-ServerActionsTestOtherB-1369156437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95a67614fa2443596fde71d819153e7',uuid=1225d1ad-70c5-43e1-b8f0-927efb3ef6be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:04:45.625286 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converting VIF {"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:45.625916 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:45.626328 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lazy-loading 'pci_devices' on Instance uuid 1225d1ad-70c5-43e1-b8f0-927efb3ef6be {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:04:45.700102 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-f3884c50-b328-4f95-b074-e416883eebdd req-e5f1d9b6-1892-4279-be65-717f82c01750 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] End _get_guest_xml xml= Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 51db6d36-20a9-4490-9210-1469eae21d03 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: instance-00000001 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 196608 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: tempest-DeleteServersTestJSON-server-671409409 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 2026-06-03 01:04:45 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 192 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: True Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: bare Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: virtio Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: tempest-DeleteServersTestJSON-1608594473-project-member Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: tempest-DeleteServersTestJSON-1608594473 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 51db6d36-20a9-4490-9210-1469eae21d03 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 51db6d36-20a9-4490-9210-1469eae21d03 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: hvm Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 128 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: Jun 03 01:04:45.729508 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:04:45.732092 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Preparing to wait for external event network-vif-plugged-99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:04:45.732092 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "51db6d36-20a9-4490-9210-1469eae21d03-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:45.732092 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:45.732092 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:45.732092 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-671409409',display_name='tempest-DeleteServersTestJSON-server-671409409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-deleteserverstestjson-server-671409409',id=1,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='458b2c2a365c46d6adcc9f193597a08a',ramdisk_id='',reservation_id='r-zqjfvnky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1608594473',owner_user_name='tempest-DeleteServersTestJSON-1608594473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:38Z,user_data=None,user_id='978123ec500f4f60a735f0f3c59dbf8e',uuid=51db6d36-20a9-4490-9210-1469eae21d03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99d6fecc-d026-4678-99ce-d8303121f361", "address": "fa:16:3e:b8:bd:73", "network": {"id": "103b91e1-d9d9-478b-9498-4552e42f3160", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106681336-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "458b2c2a365c46d6adcc9f193597a08a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d6fecc-d0", "ovs_interfaceid": "99d6fecc-d026-4678-99ce-d8303121f361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:04:45.733164 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Converting VIF {"id": "99d6fecc-d026-4678-99ce-d8303121f361", "address": "fa:16:3e:b8:bd:73", "network": {"id": "103b91e1-d9d9-478b-9498-4552e42f3160", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106681336-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "458b2c2a365c46d6adcc9f193597a08a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d6fecc-d0", "ovs_interfaceid": "99d6fecc-d026-4678-99ce-d8303121f361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:45.733164 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:bd:73,bridge_name='br-int',has_traffic_filtering=True,id=99d6fecc-d026-4678-99ce-d8303121f361,network=Network(103b91e1-d9d9-478b-9498-4552e42f3160),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d6fecc-d0') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:45.733164 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:bd:73,bridge_name='br-int',has_traffic_filtering=True,id=99d6fecc-d026-4678-99ce-d8303121f361,network=Network(103b91e1-d9d9-478b-9498-4552e42f3160),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d6fecc-d0') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:04:45.778099 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Created schema index Interface.name {{(pid=98288) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 03 01:04:45.778217 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Created schema index Port.name {{(pid=98288) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 03 01:04:45.778346 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Created schema index Bridge.name {{(pid=98288) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 03 01:04:45.778988 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98288) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jun 03 01:04:45.778988 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [POLLOUT] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:45.778988 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98288) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jun 03 01:04:45.780023 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:45.781924 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:45.826747 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:45.827013 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:45.827343 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:04:45.827943 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:45.828112 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a918ecf8-8b68-52ab-9346-3f572e2dab96', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:45.829209 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:45.829778 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:04:45.830332 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:45.831482 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp8q2et7le/privsep.sock'] Jun 03 01:04:45.841066 np0000002000 sudo[109651]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp8q2et7le/privsep.sock Jun 03 01:04:45.842729 np0000002000 sudo[109651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 03 01:04:45.869839 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:45.943135 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-b0593697-7645-4a82-951a-076f6674c082 req-6919817a-ab72-4a6e-91de-63e5db086bf4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] End _get_guest_xml xml= Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: instance-00000002 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 196608 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-server-205644783 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 2026-06-03 01:04:45 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 192 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: True Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: bare Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: virtio Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-1020364370 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: hvm Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 128 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: Jun 03 01:04:45.970866 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:04:45.974253 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Preparing to wait for external event network-vif-plugged-1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:04:45.974253 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:45.974253 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:45.974253 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:45.974253 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-205644783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-205644783',id=2,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-tga00ogs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:40Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d295ed9-260a-4fd7-a169-b87add358744", "address": "fa:16:3e:b8:08:22", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d295ed9-26", "ovs_interfaceid": "1d295ed9-260a-4fd7-a169-b87add358744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:04:45.974519 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "1d295ed9-260a-4fd7-a169-b87add358744", "address": "fa:16:3e:b8:08:22", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d295ed9-26", "ovs_interfaceid": "1d295ed9-260a-4fd7-a169-b87add358744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:45.974519 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:08:22,bridge_name='br-int',has_traffic_filtering=True,id=1d295ed9-260a-4fd7-a169-b87add358744,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d295ed9-26') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:45.974519 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:08:22,bridge_name='br-int',has_traffic_filtering=True,id=1d295ed9-260a-4fd7-a169-b87add358744,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d295ed9-26') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:04:45.974519 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:45.974519 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:45.974519 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:04:45.974519 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:45.974519 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6bd4cf43-61be-55ad-a671-7f8a75d5285e', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:45.975180 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:45.975963 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:46.096833 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 03 01:04:46.096833 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 03 01:04:46.096833 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 03 01:04:46.096833 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Jun 03 01:04:46.096833 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 03 01:04:46.096833 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 03 01:04:46.096833 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 03 01:04:46.097069 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Jun 03 01:04:46.097069 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 03 01:04:46.097696 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-4ead5870-3260-4224-a2d2-9307b86fb5d0 req-39377c28-b925-481b-9bd4-df07d16d7b7a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:46.107957 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.404s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:46.108519 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.239s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:46.109212 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:04:46.113986 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:04:46.114171 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Claim successful on node np0000002000 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] End _get_guest_xml xml= Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: instance-00000003 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 196608 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: tempest-ServerActionsTestOtherB-server-690499922 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 2026-06-03 01:04:45 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 192 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: True Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: bare Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: virtio Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: tempest-ServerActionsTestOtherB-1369156437-project-member Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: tempest-ServerActionsTestOtherB-1369156437 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: hvm Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 128 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: Jun 03 01:04:46.132467 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:04:46.138372 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Preparing to wait for external event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:04:46.138372 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:46.138372 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:46.138372 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:46.138372 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-690499922',display_name='tempest-ServerActionsTestOtherB-server-690499922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serveractionstestotherb-server-690499922',id=3,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+EmDDwoR2OvmMWSLRL3pD12IuhLKXYlFCyFD0S6tz1U811/Ppz6LfRqvK84OL/tJp7AFM3OOYK27W8pAe9Ufj1wNI9CICCs+j8JCdUBCkwgtBDQJU6o6T6RKxEkHfeyw==',key_name='tempest-keypair-122608129',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64016d71af32442f8c9e0e2fc40a542b',ramdisk_id='',reservation_id='r-mvqoecge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1369156437',owner_user_name='tempest-ServerActionsTestOtherB-1369156437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95a67614fa2443596fde71d819153e7',uuid=1225d1ad-70c5-43e1-b8f0-927efb3ef6be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:04:46.138713 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converting VIF {"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:46.138713 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:46.138713 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:04:46.138713 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:46.138713 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:46.138713 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:04:46.138713 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:46.138713 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9131e6e7-d4af-574b-b318-b6addccb32fa', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:46.141578 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:46.141578 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:04:46.192863 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Acquiring lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:46.193025 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:46.251020 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-f3884c50-b328-4f95-b074-e416883eebdd req-e5f1d9b6-1892-4279-be65-717f82c01750 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:46.409931 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 03 01:04:46.409931 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 03 01:04:46.409931 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 03 01:04:46.409931 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Jun 03 01:04:46.409931 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 03 01:04:46.409931 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 03 01:04:46.409931 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 03 01:04:46.410141 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Jun 03 01:04:46.410141 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 03 01:04:46.416037 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-b0593697-7645-4a82-951a-076f6674c082 req-6919817a-ab72-4a6e-91de-63e5db086bf4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:46.474165 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-f3884c50-b328-4f95-b074-e416883eebdd req-e5f1d9b6-1892-4279-be65-717f82c01750 service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Updated VIF entry in instance network info cache for port 99d6fecc-d026-4678-99ce-d8303121f361. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:04:46.474165 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-f3884c50-b328-4f95-b074-e416883eebdd req-e5f1d9b6-1892-4279-be65-717f82c01750 service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Updating instance_info_cache with network_info: [{"id": "99d6fecc-d026-4678-99ce-d8303121f361", "address": "fa:16:3e:b8:bd:73", "network": {"id": "103b91e1-d9d9-478b-9498-4552e42f3160", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106681336-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "458b2c2a365c46d6adcc9f193597a08a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d6fecc-d0", "ovs_interfaceid": "99d6fecc-d026-4678-99ce-d8303121f361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:46.579315 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-4ead5870-3260-4224-a2d2-9307b86fb5d0 req-39377c28-b925-481b-9bd4-df07d16d7b7a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:46.621000 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:04:46.622919 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:04:46.622919 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:46.622919 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:46.650055 np0000002000 sudo[109651]: pam_unix(sudo:session): session closed for user root Jun 03 01:04:46.652679 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Spawned new privsep daemon via rootwrap Jun 03 01:04:46.653686 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 03 01:04:46.653686 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 03 01:04:46.653767 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none Jun 03 01:04:46.653811 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109660 Jun 03 01:04:46.654578 np0000002000 nova-compute[98288]: WARNING oslo_privsep.priv_context [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] privsep daemon already running Jun 03 01:04:46.656710 np0000002000 nova-compute[98288]: WARNING oslo_privsep.priv_context [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] privsep daemon already running Jun 03 01:04:46.695199 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:04:46.779964 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-b0593697-7645-4a82-951a-076f6674c082 req-6919817a-ab72-4a6e-91de-63e5db086bf4 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Updated VIF entry in instance network info cache for port 1d295ed9-260a-4fd7-a169-b87add358744. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:04:46.780371 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-b0593697-7645-4a82-951a-076f6674c082 req-6919817a-ab72-4a6e-91de-63e5db086bf4 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Updating instance_info_cache with network_info: [{"id": "1d295ed9-260a-4fd7-a169-b87add358744", "address": "fa:16:3e:b8:08:22", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d295ed9-26", "ovs_interfaceid": "1d295ed9-260a-4fd7-a169-b87add358744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:46.806884 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '919e5ce0d0474509a9ba016ac3d78c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc0ed1bedf94d06a59a244c072d0817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:04:46.880895 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-4ead5870-3260-4224-a2d2-9307b86fb5d0 req-39377c28-b925-481b-9bd4-df07d16d7b7a service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updated VIF entry in instance network info cache for port 9055a094-dc81-45da-9637-48b820c58772. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:04:46.881240 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-4ead5870-3260-4224-a2d2-9307b86fb5d0 req-39377c28-b925-481b-9bd4-df07d16d7b7a service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updating instance_info_cache with network_info: [{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:46.896379 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:46.896652 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9055a094-dc, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:46.896989 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9055a094-dc, col_values=(('qos', UUID('0df5e759-0046-43e6-87b5-62b73c9540ac')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:46.906034 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9055a094-dc, col_values=(('external_ids', {'iface-id': '9055a094-dc81-45da-9637-48b820c58772', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:15:36', 'vm-uuid': '1225d1ad-70c5-43e1-b8f0-927efb3ef6be'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:46.924711 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:46.925791 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:04:46.928940 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:46.929463 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:46.929920 np0000002000 nova-compute[98288]: INFO os_vif [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') Jun 03 01:04:46.930257 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d295ed9-26, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:46.930544 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d295ed9-26, col_values=(('qos', UUID('ed3e23ad-f362-4a7c-abff-21fc8d6fa829')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:46.930618 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d295ed9-26, col_values=(('external_ids', {'iface-id': '1d295ed9-260a-4fd7-a169-b87add358744', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:08:22', 'vm-uuid': '4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:46.931266 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:46.932177 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:04:46.941634 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:46.942243 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:46.942394 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99d6fecc-d0, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:46.943076 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99d6fecc-d0, col_values=(('qos', UUID('b8630ce3-cfb8-43de-8b41-b3e51ee0f59d')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:46.943212 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99d6fecc-d0, col_values=(('external_ids', {'iface-id': '99d6fecc-d026-4678-99ce-d8303121f361', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:bd:73', 'vm-uuid': '51db6d36-20a9-4490-9210-1469eae21d03'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:46.944022 np0000002000 nova-compute[98288]: INFO os_vif [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:08:22,bridge_name='br-int',has_traffic_filtering=True,id=1d295ed9-260a-4fd7-a169-b87add358744,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d295ed9-26') Jun 03 01:04:46.947616 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:46.949089 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:04:46.960390 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:46.961700 np0000002000 nova-compute[98288]: INFO os_vif [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:bd:73,bridge_name='br-int',has_traffic_filtering=True,id=99d6fecc-d026-4678-99ce-d8303121f361,network=Network(103b91e1-d9d9-478b-9498-4552e42f3160),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d6fecc-d0') Jun 03 01:04:46.979052 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-f3884c50-b328-4f95-b074-e416883eebdd req-e5f1d9b6-1892-4279-be65-717f82c01750 service nova] Releasing lock "refresh_cache-51db6d36-20a9-4490-9210-1469eae21d03" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:47.133470 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:04:47.259579 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:47.284686 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b0593697-7645-4a82-951a-076f6674c082 req-6919817a-ab72-4a6e-91de-63e5db086bf4 service nova] Releasing lock "refresh_cache-4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:47.383592 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4ead5870-3260-4224-a2d2-9307b86fb5d0 req-39377c28-b925-481b-9bd4-df07d16d7b7a service nova] Releasing lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:47.396516 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Successfully created port: 549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:04:47.472825 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:04:47.472825 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:04:47.638392 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:04:47.696404 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:47.777196 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:47.817224 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "f448afac-6687-4a4a-84ff-b4478c316986" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:47.817899 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:47.852574 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:47.852752 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:47.975578 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:04:48.031964 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Successfully updated port: 549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:04:48.084295 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-cc096555-b7cc-45df-90df-4c144a33eb94 req-032f16bc-07fd-4868-b643-591e60a73925 service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Received event network-changed-549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:48.084494 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-cc096555-b7cc-45df-90df-4c144a33eb94 req-032f16bc-07fd-4868-b643-591e60a73925 service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Refreshing instance network info cache due to event network-changed-549d188f-74a8-441d-b508-47e2e9d0033f. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:04:48.084663 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-cc096555-b7cc-45df-90df-4c144a33eb94 req-032f16bc-07fd-4868-b643-591e60a73925 service nova] Acquiring lock "refresh_cache-77723037-3c0b-4a83-8cf1-6fc0fe05865d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:48.084796 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-cc096555-b7cc-45df-90df-4c144a33eb94 req-032f16bc-07fd-4868-b643-591e60a73925 service nova] Acquired lock "refresh_cache-77723037-3c0b-4a83-8cf1-6fc0fe05865d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:48.084893 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-cc096555-b7cc-45df-90df-4c144a33eb94 req-032f16bc-07fd-4868-b643-591e60a73925 service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Refreshing network info cache for port 549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:04:48.319479 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:04:48.355926 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:04:48.454085 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:04:48.454229 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:04:48.454359 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] No VIF found with MAC fa:16:3e:ee:15:36, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:04:48.454825 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Using config drive Jun 03 01:04:48.464751 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:04:48.464864 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:04:48.464936 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No VIF found with MAC fa:16:3e:b8:08:22, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:04:48.465302 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Using config drive Jun 03 01:04:48.475796 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:04:48.475909 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:04:48.476001 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] No VIF found with MAC fa:16:3e:b8:bd:73, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:04:48.476387 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Using config drive Jun 03 01:04:48.485644 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.377s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:48.486096 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:04:48.488744 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.229s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:48.490843 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:04:48.493354 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Claim successful on node np0000002000 Jun 03 01:04:48.534500 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Acquiring lock "refresh_cache-77723037-3c0b-4a83-8cf1-6fc0fe05865d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:48.586683 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-cc096555-b7cc-45df-90df-4c144a33eb94 req-032f16bc-07fd-4868-b643-591e60a73925 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:48.644805 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:04:48.645716 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:04:48.645992 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Creating image(s) Jun 03 01:04:48.647170 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Acquiring lock "/opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:48.647170 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "/opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:48.647467 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "/opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:48.647819 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:48.650653 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:48.653011 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-cc096555-b7cc-45df-90df-4c144a33eb94 req-032f16bc-07fd-4868-b643-591e60a73925 service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:04:48.655037 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:48.712587 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.057s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:48.712944 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:48.713396 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:48.713839 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:48.716318 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:48.716582 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:48.774254 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.057s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:48.774603 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:48.801634 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d/disk 1073741824" returned: 0 in 0.026s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:48.802398 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.089s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:48.802976 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:48.806431 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-cc096555-b7cc-45df-90df-4c144a33eb94 req-032f16bc-07fd-4868-b643-591e60a73925 service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:48.866977 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.064s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:48.867303 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:04:48.867520 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:48.881398 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:48.911956 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:48.926690 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d/disk --force-share --output=json" returned: 0 in 0.059s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:48.927036 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Cannot resize image /opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:04:48.927339 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:04:48.927489 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Ensure instance console log exists: /opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:04:48.927724 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:48.927918 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:48.928056 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:48.960278 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:48.970644 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:48.982463 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:48.992347 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:04:48.993894 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:04:48.994700 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:48.994700 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:49.161188 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d3ca82994a746679bd54e387b6a0214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c789ce874dc544078557d41878b032f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:04:49.308730 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-cc096555-b7cc-45df-90df-4c144a33eb94 req-032f16bc-07fd-4868-b643-591e60a73925 service nova] Releasing lock "refresh_cache-77723037-3c0b-4a83-8cf1-6fc0fe05865d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:49.309219 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Acquired lock "refresh_cache-77723037-3c0b-4a83-8cf1-6fc0fe05865d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:49.309471 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:04:49.364105 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Creating config drive at /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.config Jun 03 01:04:49.368175 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe0w6ivxw {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:49.386325 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Creating config drive at /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk.config Jun 03 01:04:49.390999 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Creating config drive at /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk.config Jun 03 01:04:49.393949 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe0w6ivxw" returned: 0 in 0.026s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:49.397522 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu2zgw423 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:49.405452 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp49k71n6 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:49.423234 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu2zgw423" returned: 0 in 0.025s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:49.442619 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp49k71n6" returned: 0 in 0.036s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:49.494012 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names Jun 03 01:04:49.524092 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:49.890516 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Successfully created port: 6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:04:49.902388 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:04:49.944635 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:04:49.945002 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:04:50.007653 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:04:50.153623 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:50.316930 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Updating instance_info_cache with network_info: [{"id": "549d188f-74a8-441d-b508-47e2e9d0033f", "address": "fa:16:3e:a0:59:a3", "network": {"id": "907bf255-961f-4cc7-88f3-bea77257bee9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-772968330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7bc0ed1bedf94d06a59a244c072d0817", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap549d188f-74", "ovs_interfaceid": "549d188f-74a8-441d-b508-47e2e9d0033f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:50.448655 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:04:50.492972 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:50.524151 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:50.598631 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:50.624666 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:50.627033 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:50.711457 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:50.726101 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:50.818837 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Releasing lock "refresh_cache-77723037-3c0b-4a83-8cf1-6fc0fe05865d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:50.819179 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Instance network_info: |[{"id": "549d188f-74a8-441d-b508-47e2e9d0033f", "address": "fa:16:3e:a0:59:a3", "network": {"id": "907bf255-961f-4cc7-88f3-bea77257bee9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-772968330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7bc0ed1bedf94d06a59a244c072d0817", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap549d188f-74", "ovs_interfaceid": "549d188f-74a8-441d-b508-47e2e9d0033f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:04:50.820901 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Start _get_guest_xml network_info=[{"id": "549d188f-74a8-441d-b508-47e2e9d0033f", "address": "fa:16:3e:a0:59:a3", "network": {"id": "907bf255-961f-4cc7-88f3-bea77257bee9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-772968330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7bc0ed1bedf94d06a59a244c072d0817", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap549d188f-74", "ovs_interfaceid": "549d188f-74a8-441d-b508-47e2e9d0033f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:04:50.823290 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:04:50.824475 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-1084391048', uuid='77723037-3c0b-4a83-8cf1-6fc0fe05865d'), owner=OwnerMeta(userid='919e5ce0d0474509a9ba016ac3d78c9e', username='tempest-VolumesAdminNegativeTest-1180237631-project-member', projectid='7bc0ed1bedf94d06a59a244c072d0817', projectname='tempest-VolumesAdminNegativeTest-1180237631'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "549d188f-74a8-441d-b508-47e2e9d0033f", "address": "fa:16:3e:a0:59:a3", "network": {"id": "907bf255-961f-4cc7-88f3-bea77257bee9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-772968330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7bc0ed1bedf94d06a59a244c072d0817", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap549d188f-74", "ovs_interfaceid": "549d188f-74a8-441d-b508-47e2e9d0033f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448690.8240876) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:04:50.829391 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Successfully updated port: 6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:04:50.832089 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:04:50.832797 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:50.834685 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:04:50.838705 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:04:50.839848 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:04:50.839848 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:04:50.841004 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:04:50.841162 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:04:50.841320 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:04:50.841387 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:04:50.841506 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:04:50.841946 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:04:50.841946 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:04:50.841946 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:04:50.841946 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:04:50.842182 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:04:50.842182 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:04:50.851265 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:50.855365 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1084391048',display_name='tempest-VolumesAdminNegativeTest-server-1084391048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-volumesadminnegativetest-server-1084391048',id=4,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc0ed1bedf94d06a59a244c072d0817',ramdisk_id='',reservation_id='r-e56v0x6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1180237631',owner_user_name='tempest-VolumesAdminNegativeTest-1180237631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:48Z,user_data=None,user_id='919e5ce0d0474509a9ba016ac3d78c9e',uuid=77723037-3c0b-4a83-8cf1-6fc0fe05865d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "549d188f-74a8-441d-b508-47e2e9d0033f", "address": "fa:16:3e:a0:59:a3", "network": {"id": "907bf255-961f-4cc7-88f3-bea77257bee9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-772968330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7bc0ed1bedf94d06a59a244c072d0817", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap549d188f-74", "ovs_interfaceid": "549d188f-74a8-441d-b508-47e2e9d0033f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:04:50.855525 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Converting VIF {"id": "549d188f-74a8-441d-b508-47e2e9d0033f", "address": "fa:16:3e:a0:59:a3", "network": {"id": "907bf255-961f-4cc7-88f3-bea77257bee9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-772968330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7bc0ed1bedf94d06a59a244c072d0817", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap549d188f-74", "ovs_interfaceid": "549d188f-74a8-441d-b508-47e2e9d0033f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:50.856106 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:59:a3,bridge_name='br-int',has_traffic_filtering=True,id=549d188f-74a8-441d-b508-47e2e9d0033f,network=Network(907bf255-961f-4cc7-88f3-bea77257bee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap549d188f-74') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:50.856686 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lazy-loading 'pci_devices' on Instance uuid 77723037-3c0b-4a83-8cf1-6fc0fe05865d {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:04:50.888099 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-a6f990be-27cf-4db8-93f0-87f0b77e9767 req-29b5e3e3-368f-43c9-a1d8-e77917c478b7 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Received event network-changed-6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:50.888099 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-a6f990be-27cf-4db8-93f0-87f0b77e9767 req-29b5e3e3-368f-43c9-a1d8-e77917c478b7 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Refreshing instance network info cache due to event network-changed-6a705171-4b6c-45df-ac14-46862c313924. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:04:50.888099 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-a6f990be-27cf-4db8-93f0-87f0b77e9767 req-29b5e3e3-368f-43c9-a1d8-e77917c478b7 service nova] Acquiring lock "refresh_cache-697c41c0-3674-4c57-b793-7ab8a4abe82a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:50.888099 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-a6f990be-27cf-4db8-93f0-87f0b77e9767 req-29b5e3e3-368f-43c9-a1d8-e77917c478b7 service nova] Acquired lock "refresh_cache-697c41c0-3674-4c57-b793-7ab8a4abe82a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:50.888099 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-a6f990be-27cf-4db8-93f0-87f0b77e9767 req-29b5e3e3-368f-43c9-a1d8-e77917c478b7 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Refreshing network info cache for port 6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:04:50.955461 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:50.958299 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.470s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:50.958751 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:04:50.960682 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.080s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:50.966578 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:04:50.966578 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Claim successful on node np0000002000 Jun 03 01:04:51.024742 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:04:51.025528 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:04:51.025779 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Creating image(s) Jun 03 01:04:51.026188 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "/opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:51.026338 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "/opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:51.026856 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "/opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:51.027089 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "ae0a5aa54390947fe24a528c81cc3bc410efb214" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:51.027874 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "ae0a5aa54390947fe24a528c81cc3bc410efb214" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:51.086791 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:51.333005 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "refresh_cache-697c41c0-3674-4c57-b793-7ab8a4abe82a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] End _get_guest_xml xml= Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 77723037-3c0b-4a83-8cf1-6fc0fe05865d Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: instance-00000004 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 196608 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: tempest-VolumesAdminNegativeTest-server-1084391048 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 2026-06-03 01:04:50 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 192 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: True Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: bare Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: virtio Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: tempest-VolumesAdminNegativeTest-1180237631-project-member Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: tempest-VolumesAdminNegativeTest-1180237631 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 77723037-3c0b-4a83-8cf1-6fc0fe05865d Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 77723037-3c0b-4a83-8cf1-6fc0fe05865d Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: hvm Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 128 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: Jun 03 01:04:51.360123 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:04:51.362209 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Preparing to wait for external event network-vif-plugged-549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:04:51.362209 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Acquiring lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:51.362209 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:51.362209 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:51.362209 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1084391048',display_name='tempest-VolumesAdminNegativeTest-server-1084391048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-volumesadminnegativetest-server-1084391048',id=4,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bc0ed1bedf94d06a59a244c072d0817',ramdisk_id='',reservation_id='r-e56v0x6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1180237631',owner_user_name='tempest-VolumesAdminNegativeTest-1180237631-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:48Z,user_data=None,user_id='919e5ce0d0474509a9ba016ac3d78c9e',uuid=77723037-3c0b-4a83-8cf1-6fc0fe05865d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "549d188f-74a8-441d-b508-47e2e9d0033f", "address": "fa:16:3e:a0:59:a3", "network": {"id": "907bf255-961f-4cc7-88f3-bea77257bee9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-772968330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7bc0ed1bedf94d06a59a244c072d0817", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap549d188f-74", "ovs_interfaceid": "549d188f-74a8-441d-b508-47e2e9d0033f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:04:51.362423 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Converting VIF {"id": "549d188f-74a8-441d-b508-47e2e9d0033f", "address": "fa:16:3e:a0:59:a3", "network": {"id": "907bf255-961f-4cc7-88f3-bea77257bee9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-772968330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7bc0ed1bedf94d06a59a244c072d0817", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap549d188f-74", "ovs_interfaceid": "549d188f-74a8-441d-b508-47e2e9d0033f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:51.363033 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:59:a3,bridge_name='br-int',has_traffic_filtering=True,id=549d188f-74a8-441d-b508-47e2e9d0033f,network=Network(907bf255-961f-4cc7-88f3-bea77257bee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap549d188f-74') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:51.363328 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:59:a3,bridge_name='br-int',has_traffic_filtering=True,id=549d188f-74a8-441d-b508-47e2e9d0033f,network=Network(907bf255-961f-4cc7-88f3-bea77257bee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap549d188f-74') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:04:51.363778 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:51.364593 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:51.364908 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:04:51.365881 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:51.366089 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6650778-cedd-5ee9-a58d-587c9e405a6a', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:51.367022 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:51.368356 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:04:51.370454 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:51.370638 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap549d188f-74, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:51.371044 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap549d188f-74, col_values=(('qos', UUID('e6a88f42-cca5-4d61-b670-c0c9f2765177')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:51.371235 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap549d188f-74, col_values=(('external_ids', {'iface-id': '549d188f-74a8-441d-b508-47e2e9d0033f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:59:a3', 'vm-uuid': '77723037-3c0b-4a83-8cf1-6fc0fe05865d'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:51.372110 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:51.373805 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:04:51.377148 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:51.377987 np0000002000 nova-compute[98288]: INFO os_vif [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:59:a3,bridge_name='br-int',has_traffic_filtering=True,id=549d188f-74a8-441d-b508-47e2e9d0033f,network=Network(907bf255-961f-4cc7-88f3-bea77257bee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap549d188f-74') Jun 03 01:04:51.389600 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-a6f990be-27cf-4db8-93f0-87f0b77e9767 req-29b5e3e3-368f-43c9-a1d8-e77917c478b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:51.462156 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-a6f990be-27cf-4db8-93f0-87f0b77e9767 req-29b5e3e3-368f-43c9-a1d8-e77917c478b7 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:04:51.470109 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:04:51.472254 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:04:51.472526 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:51.472863 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:51.581878 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82aac57c5a3748a48909892b77417b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321c47ec5882416fa2c077d65bcce48c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:04:51.681011 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-a6f990be-27cf-4db8-93f0-87f0b77e9767 req-29b5e3e3-368f-43c9-a1d8-e77917c478b7 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:51.882507 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [-] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:04:51.883950 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] VM Started (Lifecycle Event) Jun 03 01:04:51.943322 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:51.947436 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:51.948475 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214.part --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:51.971989 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:04:52.014556 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214.part --force-share --output=json" returned: 0 in 0.067s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:52.014890 np0000002000 nova-compute[98288]: DEBUG nova.virt.images [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] 1f393b31-76b2-414c-aa54-aa84cfe3f2a5 was qcow2, converting to raw {{(pid=98288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 03 01:04:52.015483 np0000002000 nova-compute[98288]: DEBUG nova.privsep.utils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 03 01:04:52.015756 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214.part /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214.converted {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:52.174013 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Successfully created port: 384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:04:52.184863 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-a6f990be-27cf-4db8-93f0-87f0b77e9767 req-29b5e3e3-368f-43c9-a1d8-e77917c478b7 service nova] Releasing lock "refresh_cache-697c41c0-3674-4c57-b793-7ab8a4abe82a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:52.186283 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquired lock "refresh_cache-697c41c0-3674-4c57-b793-7ab8a4abe82a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:52.186283 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:04:52.214215 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214.part /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214.converted" returned: 0 in 0.198s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:52.218726 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214.converted --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:52.282243 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214.converted --force-share --output=json" returned: 0 in 0.063s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:52.283452 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "ae0a5aa54390947fe24a528c81cc3bc410efb214" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.256s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:52.284166 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:52.290570 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:52.298583 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:52.365531 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214 --force-share --output=json" returned: 0 in 0.063s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:52.365531 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "ae0a5aa54390947fe24a528c81cc3bc410efb214" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:52.365531 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "ae0a5aa54390947fe24a528c81cc3bc410efb214" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:52.365531 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:52.367632 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:52.368696 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:52.396595 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:04:52.405398 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:04:52.405606 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] VM Paused (Lifecycle Event) Jun 03 01:04:52.430234 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214 --force-share --output=json" returned: 0 in 0.061s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:52.430583 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214,backing_fmt=raw /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:52.465911 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214,backing_fmt=raw /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk 1073741824" returned: 0 in 0.035s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:52.466413 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "ae0a5aa54390947fe24a528c81cc3bc410efb214" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.106s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:52.466771 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:52.484533 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:04:52.544701 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:04:52.544701 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:04:52.550381 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae0a5aa54390947fe24a528c81cc3bc410efb214 --force-share --output=json" returned: 0 in 0.084s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:52.552459 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:04:52.552459 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:52.619653 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk --force-share --output=json" returned: 0 in 0.068s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:52.620548 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Cannot resize image /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:04:52.621226 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:04:52.621296 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Ensure instance console log exists: /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:04:52.621677 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:52.621967 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:52.622131 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:52.716758 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Successfully updated port: 384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:04:52.778305 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:52.799803 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:04:52.900519 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:04:52.900666 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:04:52.900797 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] No VIF found with MAC fa:16:3e:a0:59:a3, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:04:52.901468 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Using config drive Jun 03 01:04:52.908569 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:04:52.910600 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:04:52.967339 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e61308dd-31d8-47c8-9425-7d0710b43f18 req-62b936c1-cf86-41ae-892f-a7d36ea7a5b6 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Received event network-changed-384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:52.968240 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e61308dd-31d8-47c8-9425-7d0710b43f18 req-62b936c1-cf86-41ae-892f-a7d36ea7a5b6 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Refreshing instance network info cache due to event network-changed-384a12cb-fb42-4a82-8fa4-e199eb9c4675. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:04:52.968240 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e61308dd-31d8-47c8-9425-7d0710b43f18 req-62b936c1-cf86-41ae-892f-a7d36ea7a5b6 service nova] Acquiring lock "refresh_cache-9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:52.968240 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e61308dd-31d8-47c8-9425-7d0710b43f18 req-62b936c1-cf86-41ae-892f-a7d36ea7a5b6 service nova] Acquired lock "refresh_cache-9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:52.968605 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-e61308dd-31d8-47c8-9425-7d0710b43f18 req-62b936c1-cf86-41ae-892f-a7d36ea7a5b6 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Refreshing network info cache for port 384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:04:53.036988 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:53.050348 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:04:53.171431 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:53.178038 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:53.180137 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:53.201856 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:53.211069 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:53.219625 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Acquiring lock "refresh_cache-9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:53.270464 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Updating instance_info_cache with network_info: [{"id": "6a705171-4b6c-45df-ac14-46862c313924", "address": "fa:16:3e:d9:ee:44", "network": {"id": "3bbe9fd2-9242-4876-a8e2-e7d15f27293f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890948811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c789ce874dc544078557d41878b032f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a705171-4b", "ovs_interfaceid": "6a705171-4b6c-45df-ac14-46862c313924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:53.406425 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:53.413187 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:04:53.413656 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:04:53.413889 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] VM Started (Lifecycle Event) Jun 03 01:04:53.473171 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-e61308dd-31d8-47c8-9425-7d0710b43f18 req-62b936c1-cf86-41ae-892f-a7d36ea7a5b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:53.495517 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:04:53.496506 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:04:53.497109 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Creating image(s) Jun 03 01:04:53.499100 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Acquiring lock "/opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:53.499100 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "/opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:53.499100 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "/opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:53.499100 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:53.502781 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:53.504223 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:53.557793 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.597s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:53.562566 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-e61308dd-31d8-47c8-9425-7d0710b43f18 req-62b936c1-cf86-41ae-892f-a7d36ea7a5b6 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:04:53.566114 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.649s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:53.569672 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:04:53.574510 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.070s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:53.577360 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:04:53.580496 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:53.580577 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Claim successful on node np0000002000 Jun 03 01:04:53.583760 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.006s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:53.585390 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:53.589462 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:53.589928 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:53.634300 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Creating config drive at /opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d/disk.config Jun 03 01:04:53.640807 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxyt9rsa9 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:53.666256 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.076s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:53.666772 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:53.674418 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxyt9rsa9" returned: 0 in 0.033s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:53.703752 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk 1073741824" returned: 0 in 0.037s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:53.704341 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.120s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:53.706315 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:53.774322 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Releasing lock "refresh_cache-697c41c0-3674-4c57-b793-7ab8a4abe82a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:53.774322 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Instance network_info: |[{"id": "6a705171-4b6c-45df-ac14-46862c313924", "address": "fa:16:3e:d9:ee:44", "network": {"id": "3bbe9fd2-9242-4876-a8e2-e7d15f27293f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890948811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c789ce874dc544078557d41878b032f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a705171-4b", "ovs_interfaceid": "6a705171-4b6c-45df-ac14-46862c313924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:04:53.775108 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Start _get_guest_xml network_info=[{"id": "6a705171-4b6c-45df-ac14-46862c313924", "address": "fa:16:3e:d9:ee:44", "network": {"id": "3bbe9fd2-9242-4876-a8e2-e7d15f27293f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890948811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c789ce874dc544078557d41878b032f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a705171-4b", "ovs_interfaceid": "6a705171-4b6c-45df-ac14-46862c313924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:04:37Z,direct_url=,disk_format='qcow2',id=1f393b31-76b2-414c-aa54-aa84cfe3f2a5,min_disk=0,min_ram=0,name='',owner='037b668b9d1845dabff5630667b8a102',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:04:39Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/sda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_options': None, 'image_id': '1f393b31-76b2-414c-aa54-aa84cfe3f2a5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:04:53.775987 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.071s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:53.776433 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:04:53.776694 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:53.791980 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-e61308dd-31d8-47c8-9425-7d0710b43f18 req-62b936c1-cf86-41ae-892f-a7d36ea7a5b6 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:53.793385 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:04:53.794852 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1f393b31-76b2-414c-aa54-aa84cfe3f2a5', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-743073027', uuid='697c41c0-3674-4c57-b793-7ab8a4abe82a'), owner=OwnerMeta(userid='2d3ca82994a746679bd54e387b6a0214', username='tempest-AttachSCSIVolumeTestJSON-1913972656-project-member', projectid='c789ce874dc544078557d41878b032f2', projectname='tempest-AttachSCSIVolumeTestJSON-1913972656'), image=ImageMeta(id='1f393b31-76b2-414c-aa54-aa84cfe3f2a5', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6a705171-4b6c-45df-ac14-46862c313924", "address": "fa:16:3e:d9:ee:44", "network": {"id": "3bbe9fd2-9242-4876-a8e2-e7d15f27293f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890948811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c789ce874dc544078557d41878b032f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a705171-4b", "ovs_interfaceid": "6a705171-4b6c-45df-ac14-46862c313924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448693.794493) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:04:53.805750 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:04:53.806074 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:04:53.811489 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:04:53.811489 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:04:53.811489 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:04:53.811814 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:04:37Z,direct_url=,disk_format='qcow2',id=1f393b31-76b2-414c-aa54-aa84cfe3f2a5,min_disk=0,min_ram=0,name='',owner='037b668b9d1845dabff5630667b8a102',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:04:39Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:04:53.812020 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:04:53.812348 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:04:53.812562 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:04:53.812722 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:04:53.812856 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:04:53.813085 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:04:53.813485 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:04:53.813485 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:04:53.813595 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:04:53.813773 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:04:53.832556 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-743073027',display_name='tempest-AttachSCSIVolumeTestJSON-server-743073027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-attachscsivolumetestjson-server-743073027',id=5,image_ref='1f393b31-76b2-414c-aa54-aa84cfe3f2a5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkmvWN6Ogv3jl3xunvxsecfR2agWAUfDUKPp6EXqbASUB5k9Op1GZr/eJGHMglaTxwu+mjTpET+l0EaxHt0Tkk8/dkQcVkU3IB5HnDqtSWQIC3KqSQO7XYF2cUruwiXUg==',key_name='tempest-keypair-734539003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c789ce874dc544078557d41878b032f2',ramdisk_id='',reservation_id='r-qmui8520',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f393b31-76b2-414c-aa54-aa84cfe3f2a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1913972656',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1913972656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3ca82994a746679bd54e387b6a0214',uuid=697c41c0-3674-4c57-b793-7ab8a4abe82a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a705171-4b6c-45df-ac14-46862c313924", "address": "fa:16:3e:d9:ee:44", "network": {"id": "3bbe9fd2-9242-4876-a8e2-e7d15f27293f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890948811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c789ce874dc544078557d41878b032f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a705171-4b", "ovs_interfaceid": "6a705171-4b6c-45df-ac14-46862c313924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:04:53.832739 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Converting VIF {"id": "6a705171-4b6c-45df-ac14-46862c313924", "address": "fa:16:3e:d9:ee:44", "network": {"id": "3bbe9fd2-9242-4876-a8e2-e7d15f27293f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890948811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c789ce874dc544078557d41878b032f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a705171-4b", "ovs_interfaceid": "6a705171-4b6c-45df-ac14-46862c313924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:53.834022 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=6a705171-4b6c-45df-ac14-46862c313924,network=Network(3bbe9fd2-9242-4876-a8e2-e7d15f27293f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a705171-4b') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:53.834224 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lazy-loading 'pci_devices' on Instance uuid 697c41c0-3674-4c57-b793-7ab8a4abe82a {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:04:53.842459 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:53.843994 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Cannot resize image /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:04:53.843994 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:04:53.843994 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Ensure instance console log exists: /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:04:53.843994 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:53.843994 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:53.843994 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:53.919656 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:04:53.924746 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:04:53.924908 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] VM Paused (Lifecycle Event) Jun 03 01:04:53.992870 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.001111 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.003215 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.020658 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.026882 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.093712 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.098426 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:04:54.098426 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:04:54.098561 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:54.098853 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:54.109082 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.172830 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f245211bf5994e21bfe59c811ea624a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497a75226ead41d0b5de0b5e17c7c55c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:04:54.198778 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.295927 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e61308dd-31d8-47c8-9425-7d0710b43f18 req-62b936c1-cf86-41ae-892f-a7d36ea7a5b6 service nova] Releasing lock "refresh_cache-9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:54.296628 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Acquired lock "refresh_cache-9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:54.296628 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] End _get_guest_xml xml= Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 697c41c0-3674-4c57-b793-7ab8a4abe82a Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: instance-00000005 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 196608 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: tempest-AttachSCSIVolumeTestJSON-server-743073027 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 2026-06-03 01:04:53 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 192 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: True Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: bare Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: scsi Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: scsi Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: virtio-scsi Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: tempest-AttachSCSIVolumeTestJSON-1913972656-project-member Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: tempest-AttachSCSIVolumeTestJSON-1913972656 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 697c41c0-3674-4c57-b793-7ab8a4abe82a Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 697c41c0-3674-4c57-b793-7ab8a4abe82a Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: hvm Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 128 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]:
Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]:
Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: Jun 03 01:04:54.337224 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:04:54.343830 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Preparing to wait for external event network-vif-plugged-6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:04:54.343830 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:54.343830 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:54.343830 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:54.343830 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-743073027',display_name='tempest-AttachSCSIVolumeTestJSON-server-743073027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-attachscsivolumetestjson-server-743073027',id=5,image_ref='1f393b31-76b2-414c-aa54-aa84cfe3f2a5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkmvWN6Ogv3jl3xunvxsecfR2agWAUfDUKPp6EXqbASUB5k9Op1GZr/eJGHMglaTxwu+mjTpET+l0EaxHt0Tkk8/dkQcVkU3IB5HnDqtSWQIC3KqSQO7XYF2cUruwiXUg==',key_name='tempest-keypair-734539003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c789ce874dc544078557d41878b032f2',ramdisk_id='',reservation_id='r-qmui8520',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f393b31-76b2-414c-aa54-aa84cfe3f2a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1913972656',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1913972656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3ca82994a746679bd54e387b6a0214',uuid=697c41c0-3674-4c57-b793-7ab8a4abe82a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a705171-4b6c-45df-ac14-46862c313924", "address": "fa:16:3e:d9:ee:44", "network": {"id": "3bbe9fd2-9242-4876-a8e2-e7d15f27293f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890948811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c789ce874dc544078557d41878b032f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a705171-4b", "ovs_interfaceid": "6a705171-4b6c-45df-ac14-46862c313924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:04:54.344219 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Converting VIF {"id": "6a705171-4b6c-45df-ac14-46862c313924", "address": "fa:16:3e:d9:ee:44", "network": {"id": "3bbe9fd2-9242-4876-a8e2-e7d15f27293f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890948811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c789ce874dc544078557d41878b032f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a705171-4b", "ovs_interfaceid": "6a705171-4b6c-45df-ac14-46862c313924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:54.344219 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=6a705171-4b6c-45df-ac14-46862c313924,network=Network(3bbe9fd2-9242-4876-a8e2-e7d15f27293f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a705171-4b') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:54.344219 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=6a705171-4b6c-45df-ac14-46862c313924,network=Network(3bbe9fd2-9242-4876-a8e2-e7d15f27293f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a705171-4b') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:04:54.344219 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.344219 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:54.344219 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:04:54.344219 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.344219 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82312598-05d3-5aa3-8356-d2fc6b600dfc', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:54.344219 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.344219 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:04:54.344219 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.346968 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.349953 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a705171-4b, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:54.350419 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a705171-4b, col_values=(('qos', UUID('862c5aff-f2d6-4c6f-b1ef-3e27d3f09c0b')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:54.350692 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a705171-4b, col_values=(('external_ids', {'iface-id': '6a705171-4b6c-45df-ac14-46862c313924', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:ee:44', 'vm-uuid': '697c41c0-3674-4c57-b793-7ab8a4abe82a'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:54.353048 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.361325 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:04:54.361754 np0000002000 nova-compute[98288]: INFO os_vif [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=6a705171-4b6c-45df-ac14-46862c313924,network=Network(3bbe9fd2-9242-4876-a8e2-e7d15f27293f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a705171-4b') Jun 03 01:04:54.394687 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-541d6402-c9d5-46a8-aa3c-4223d50da4cf req-7a672b84-288b-4cb2-9772-f8fdf71ebbd9 service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Received event network-vif-unplugged-99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:54.394687 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-541d6402-c9d5-46a8-aa3c-4223d50da4cf req-7a672b84-288b-4cb2-9772-f8fdf71ebbd9 service nova] Acquiring lock "51db6d36-20a9-4490-9210-1469eae21d03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:54.395129 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-541d6402-c9d5-46a8-aa3c-4223d50da4cf req-7a672b84-288b-4cb2-9772-f8fdf71ebbd9 service nova] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:54.395129 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-541d6402-c9d5-46a8-aa3c-4223d50da4cf req-7a672b84-288b-4cb2-9772-f8fdf71ebbd9 service nova] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:54.395311 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-541d6402-c9d5-46a8-aa3c-4223d50da4cf req-7a672b84-288b-4cb2-9772-f8fdf71ebbd9 service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] No event matching network-vif-unplugged-99d6fecc-d026-4678-99ce-d8303121f361 in dict_keys([('network-vif-plugged', '99d6fecc-d026-4678-99ce-d8303121f361')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:04:54.395433 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-541d6402-c9d5-46a8-aa3c-4223d50da4cf req-7a672b84-288b-4cb2-9772-f8fdf71ebbd9 service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Received unexpected event network-vif-unplugged-99d6fecc-d026-4678-99ce-d8303121f361 for instance with vm_state building and task_state spawning. Jun 03 01:04:54.427181 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:04:54.434171 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:04:54.471925 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.477044 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.479177 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.501313 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.508121 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.601126 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:04:54.731780 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Successfully created port: c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:04:54.935836 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:04:54.936143 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:04:54.936297 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] VM Started (Lifecycle Event) Jun 03 01:04:54.941027 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.956046 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.972002 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:54.976732 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:55.049564 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:04:55.091549 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:04:55.091830 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:04:55.104375 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:04:55.220045 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Successfully updated port: c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:04:55.256535 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:55.265842 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e4942ca8-fb32-43e8-aad3-e5e6fc39940a req-9f12a3cc-6259-4d5b-a859-c9e3ae832395 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Received event network-changed-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:55.266261 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e4942ca8-fb32-43e8-aad3-e5e6fc39940a req-9f12a3cc-6259-4d5b-a859-c9e3ae832395 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Refreshing instance network info cache due to event network-changed-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:04:55.266482 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e4942ca8-fb32-43e8-aad3-e5e6fc39940a req-9f12a3cc-6259-4d5b-a859-c9e3ae832395 service nova] Acquiring lock "refresh_cache-f448afac-6687-4a4a-84ff-b4478c316986" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:55.266644 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e4942ca8-fb32-43e8-aad3-e5e6fc39940a req-9f12a3cc-6259-4d5b-a859-c9e3ae832395 service nova] Acquired lock "refresh_cache-f448afac-6687-4a4a-84ff-b4478c316986" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:55.266881 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-e4942ca8-fb32-43e8-aad3-e5e6fc39940a req-9f12a3cc-6259-4d5b-a859-c9e3ae832395 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Refreshing network info cache for port c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:04:55.370760 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Updating instance_info_cache with network_info: [{"id": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "address": "fa:16:3e:d9:fd:f9", "network": {"id": "aca22e29-c397-4c4f-a985-57057a027e42", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-933421303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321c47ec5882416fa2c077d65bcce48c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap384a12cb-fb", "ovs_interfaceid": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:55.439391 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:04:55.440552 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:04:55.440718 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] VM Paused (Lifecycle Event) Jun 03 01:04:55.595056 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:04:55.721745 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "refresh_cache-f448afac-6687-4a4a-84ff-b4478c316986" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:55.768848 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-e4942ca8-fb32-43e8-aad3-e5e6fc39940a req-9f12a3cc-6259-4d5b-a859-c9e3ae832395 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:55.826825 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-e4942ca8-fb32-43e8-aad3-e5e6fc39940a req-9f12a3cc-6259-4d5b-a859-c9e3ae832395 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:04:55.872465 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Releasing lock "refresh_cache-9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:55.872739 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Instance network_info: |[{"id": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "address": "fa:16:3e:d9:fd:f9", "network": {"id": "aca22e29-c397-4c4f-a985-57057a027e42", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-933421303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321c47ec5882416fa2c077d65bcce48c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap384a12cb-fb", "ovs_interfaceid": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:04:55.874529 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Start _get_guest_xml network_info=[{"id": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "address": "fa:16:3e:d9:fd:f9", "network": {"id": "aca22e29-c397-4c4f-a985-57057a027e42", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-933421303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321c47ec5882416fa2c077d65bcce48c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap384a12cb-fb", "ovs_interfaceid": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:04:55.876699 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:04:55.877739 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-2130936346', uuid='9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1'), owner=OwnerMeta(userid='82aac57c5a3748a48909892b77417b42', username='tempest-VolumesAssistedSnapshotsTest-1266849806-project-member', projectid='321c47ec5882416fa2c077d65bcce48c', projectname='tempest-VolumesAssistedSnapshotsTest-1266849806'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "address": "fa:16:3e:d9:fd:f9", "network": {"id": "aca22e29-c397-4c4f-a985-57057a027e42", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-933421303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321c47ec5882416fa2c077d65bcce48c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap384a12cb-fb", "ovs_interfaceid": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448695.877328) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:04:55.879695 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:04:55.879695 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] No BDM found with device name sda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:04:55.879695 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:04:55.879695 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] No VIF found with MAC fa:16:3e:d9:ee:44, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:04:55.880052 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:04:55.880686 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Using config drive Jun 03 01:04:55.882218 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:04:55.882463 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:04:55.883246 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:04:55.883659 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:04:55.883797 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:04:55.883896 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:04:55.884003 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:04:55.884094 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:04:55.884170 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:04:55.884312 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:04:55.884473 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:04:55.884840 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:04:55.884989 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:04:55.885112 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:04:55.894951 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2130936346',display_name='tempest-VolumesAssistedSnapshotsTest-server-2130936346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-volumesassistedsnapshotstest-server-2130936346',id=6,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIWZ+6rFnDIISVEJBhGUFE7eADqv8YEEzNOnPIoIyhpJxXUDK88KXzTr64TBkb9U29yDwrjAQ+WSTannzbKwNGEO+XD97GVOe3W+4Aakh5IFg76l8OKkApn0jEMOnO3Ow==',key_name='tempest-keypair-212004546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='321c47ec5882416fa2c077d65bcce48c',ramdisk_id='',reservation_id='r-els0wz36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1266849806',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1266849806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82aac57c5a3748a48909892b77417b42',uuid=9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "address": "fa:16:3e:d9:fd:f9", "network": {"id": "aca22e29-c397-4c4f-a985-57057a027e42", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-933421303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321c47ec5882416fa2c077d65bcce48c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap384a12cb-fb", "ovs_interfaceid": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:04:55.895194 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Converting VIF {"id": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "address": "fa:16:3e:d9:fd:f9", "network": {"id": "aca22e29-c397-4c4f-a985-57057a027e42", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-933421303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321c47ec5882416fa2c077d65bcce48c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap384a12cb-fb", "ovs_interfaceid": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:55.895771 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=384a12cb-fb42-4a82-8fa4-e199eb9c4675,network=Network(aca22e29-c397-4c4f-a985-57057a027e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384a12cb-fb') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:55.896255 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lazy-loading 'pci_devices' on Instance uuid 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:04:55.943037 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:04:55.943991 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:04:55.974680 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-e4942ca8-fb32-43e8-aad3-e5e6fc39940a req-9f12a3cc-6259-4d5b-a859-c9e3ae832395 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:56.103413 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.543s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:56.103933 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:04:56.111706 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:04:56.112947 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:04:56.113175 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Creating image(s) Jun 03 01:04:56.113715 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "/opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:56.113982 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "/opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:56.114315 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "/opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:56.114830 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:56.117579 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:56.118538 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:56.182671 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.064s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:56.182934 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:56.183409 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:56.183872 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:56.186457 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:56.186969 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:56.253452 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.066s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:56.254380 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:56.284121 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk 1073741824" returned: 0 in 0.030s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:56.284594 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.101s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:56.284908 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:56.354104 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.069s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:56.354514 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:04:56.354744 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:56.389970 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] End _get_guest_xml xml= Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: instance-00000006 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 196608 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: tempest-VolumesAssistedSnapshotsTest-server-2130936346 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 2026-06-03 01:04:55 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 192 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: True Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: bare Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: virtio Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: tempest-VolumesAssistedSnapshotsTest-1266849806-project-member Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: tempest-VolumesAssistedSnapshotsTest-1266849806 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: hvm Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 128 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: Jun 03 01:04:56.399949 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:04:56.401833 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Preparing to wait for external event network-vif-plugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:04:56.401833 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Acquiring lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:56.401833 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:56.401833 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:56.401975 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2130936346',display_name='tempest-VolumesAssistedSnapshotsTest-server-2130936346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-volumesassistedsnapshotstest-server-2130936346',id=6,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIWZ+6rFnDIISVEJBhGUFE7eADqv8YEEzNOnPIoIyhpJxXUDK88KXzTr64TBkb9U29yDwrjAQ+WSTannzbKwNGEO+XD97GVOe3W+4Aakh5IFg76l8OKkApn0jEMOnO3Ow==',key_name='tempest-keypair-212004546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='321c47ec5882416fa2c077d65bcce48c',ramdisk_id='',reservation_id='r-els0wz36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1266849806',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1266849806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82aac57c5a3748a48909892b77417b42',uuid=9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "address": "fa:16:3e:d9:fd:f9", "network": {"id": "aca22e29-c397-4c4f-a985-57057a027e42", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-933421303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321c47ec5882416fa2c077d65bcce48c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap384a12cb-fb", "ovs_interfaceid": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:04:56.402211 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Converting VIF {"id": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "address": "fa:16:3e:d9:fd:f9", "network": {"id": "aca22e29-c397-4c4f-a985-57057a027e42", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-933421303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321c47ec5882416fa2c077d65bcce48c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap384a12cb-fb", "ovs_interfaceid": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:56.402995 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=384a12cb-fb42-4a82-8fa4-e199eb9c4675,network=Network(aca22e29-c397-4c4f-a985-57057a027e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384a12cb-fb') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:56.403305 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=384a12cb-fb42-4a82-8fa4-e199eb9c4675,network=Network(aca22e29-c397-4c4f-a985-57057a027e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384a12cb-fb') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:04:56.403704 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:56.404054 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:56.404403 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:04:56.406242 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:56.406409 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be199f09-cc81-51ed-9e91-78295343cc81', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:56.407167 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:56.407979 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:04:56.413975 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:56.416528 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:56.416717 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap384a12cb-fb, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:56.417098 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap384a12cb-fb, col_values=(('qos', UUID('10b5ef96-c2cb-4b28-b7f4-f6d946a2266f')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:56.417291 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap384a12cb-fb, col_values=(('external_ids', {'iface-id': '384a12cb-fb42-4a82-8fa4-e199eb9c4675', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:fd:f9', 'vm-uuid': '9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:56.418093 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:56.419530 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:04:56.420394 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:56.420711 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Cannot resize image /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:04:56.420938 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:04:56.421274 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Ensure instance console log exists: /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:04:56.421517 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:56.421669 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:56.421794 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:56.428766 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:56.429991 np0000002000 nova-compute[98288]: INFO os_vif [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=384a12cb-fb42-4a82-8fa4-e199eb9c4675,network=Network(aca22e29-c397-4c4f-a985-57057a027e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384a12cb-fb') Jun 03 01:04:56.445825 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] VM Started (Lifecycle Event) Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Received event network-vif-unplugged-549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Acquiring lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] No event matching network-vif-unplugged-549d188f-74a8-441d-b508-47e2e9d0033f in dict_keys([('network-vif-plugged', '549d188f-74a8-441d-b508-47e2e9d0033f')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Received unexpected event network-vif-unplugged-549d188f-74a8-441d-b508-47e2e9d0033f for instance with vm_state building and task_state spawning. Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Received event network-vif-plugged-99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Acquiring lock "51db6d36-20a9-4490-9210-1469eae21d03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Processing event network-vif-plugged-99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Received event network-vif-plugged-99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:56.851342 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Acquiring lock "51db6d36-20a9-4490-9210-1469eae21d03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] No waiting events found dispatching network-vif-plugged-99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Received unexpected event network-vif-plugged-99d6fecc-d026-4678-99ce-d8303121f361 for instance with vm_state building and task_state spawning. Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Received event network-vif-unplugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Acquiring lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] No event matching network-vif-unplugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 in dict_keys([('network-vif-plugged', '384a12cb-fb42-4a82-8fa4-e199eb9c4675')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Received unexpected event network-vif-unplugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 for instance with vm_state building and task_state spawning. Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Received event network-vif-plugged-549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Acquiring lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:56.852654 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Processing event network-vif-plugged-549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Received event network-vif-plugged-549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Acquiring lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] No waiting events found dispatching network-vif-plugged-549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-4e409584-5e94-48ca-a009-5e367ba7d393 req-3a50d55c-322b-4a99-b9f4-bd3366912edb service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Received unexpected event network-vif-plugged-549d188f-74a8-441d-b508-47e2e9d0033f for instance with vm_state building and task_state spawning. Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Instance spawned successfully. Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e4942ca8-fb32-43e8-aad3-e5e6fc39940a req-9f12a3cc-6259-4d5b-a859-c9e3ae832395 service nova] Releasing lock "refresh_cache-f448afac-6687-4a4a-84ff-b4478c316986" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquired lock "refresh_cache-f448afac-6687-4a4a-84ff-b4478c316986" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:04:56.853269 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Instance spawned successfully. Jun 03 01:04:56.853982 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:04:56.853982 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Creating config drive at /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk.config Jun 03 01:04:56.853982 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp23g2zpo5 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:56.853982 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp23g2zpo5" returned: 0 in 0.028s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:56.853982 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:04:56.853982 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:04:56.853982 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:56.853982 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:56.853982 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f245211bf5994e21bfe59c811ea624a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497a75226ead41d0b5de0b5e17c7c55c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:04:56.950046 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:04:56.956989 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:04:56.986461 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:04:56.986461 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:04:56.986461 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:04:56.986461 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:04:56.986461 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:04:56.986461 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:04:56.995101 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:04:56.995244 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:04:56.995557 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:04:56.995814 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:04:56.996081 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:04:56.996405 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:04:57.068027 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:57.075128 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:04:57.101751 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:57.108398 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:57.115305 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:04:57.187603 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:57.251393 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Successfully created port: d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:04:57.325567 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:57.418104 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:57.452143 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c42079ee-c072-4d03-8b60-33169bd0778b req-41e2844c-340c-453b-b07f-a8329a165302 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:57.452990 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c42079ee-c072-4d03-8b60-33169bd0778b req-41e2844c-340c-453b-b07f-a8329a165302 service nova] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:57.455032 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c42079ee-c072-4d03-8b60-33169bd0778b req-41e2844c-340c-453b-b07f-a8329a165302 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:57.455459 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c42079ee-c072-4d03-8b60-33169bd0778b req-41e2844c-340c-453b-b07f-a8329a165302 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:57.455737 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c42079ee-c072-4d03-8b60-33169bd0778b req-41e2844c-340c-453b-b07f-a8329a165302 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] No event matching network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 in dict_keys([('network-vif-plugged', '9055a094-dc81-45da-9637-48b820c58772')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:04:57.455737 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-c42079ee-c072-4d03-8b60-33169bd0778b req-41e2844c-340c-453b-b07f-a8329a165302 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received unexpected event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 for instance with vm_state building and task_state spawning. Jun 03 01:04:57.459010 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:04:57.459385 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:04:57.459769 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] VM Paused (Lifecycle Event) Jun 03 01:04:57.490683 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Took 18.30 seconds to spawn the instance on the hypervisor. Jun 03 01:04:57.490947 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:04:57.492835 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:57.496196 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:57.503885 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Took 8.86 seconds to spawn the instance on the hypervisor. Jun 03 01:04:57.505145 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:04:57.518310 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:57.526005 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:57.542337 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Updating instance_info_cache with network_info: [{"id": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "address": "fa:16:3e:5c:d4:cc", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ca89c7-5e", "ovs_interfaceid": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:57.620261 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:04:57.779959 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:57.954430 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:04:57.954590 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:04:57.954704 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] No VIF found with MAC fa:16:3e:d9:fd:f9, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:04:57.955118 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Using config drive Jun 03 01:04:57.962467 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:04:57.966672 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:04:57.966789 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] VM Resumed (Lifecycle Event) Jun 03 01:04:58.008957 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Took 23.60 seconds to build instance. Jun 03 01:04:58.023563 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Took 14.39 seconds to build instance. Jun 03 01:04:58.044557 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Releasing lock "refresh_cache-f448afac-6687-4a4a-84ff-b4478c316986" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:58.044670 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Instance network_info: |[{"id": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "address": "fa:16:3e:5c:d4:cc", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ca89c7-5e", "ovs_interfaceid": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:04:58.046503 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Start _get_guest_xml network_info=[{"id": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "address": "fa:16:3e:5c:d4:cc", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ca89c7-5e", "ovs_interfaceid": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:04:58.049778 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:04:58.050919 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-751623019-1', uuid='f448afac-6687-4a4a-84ff-b4478c316986'), owner=OwnerMeta(userid='f245211bf5994e21bfe59c811ea624a0', username='tempest-TestMultiAttachVolumeSwap-2138682875-project-member', projectid='497a75226ead41d0b5de0b5e17c7c55c', projectname='tempest-TestMultiAttachVolumeSwap-2138682875'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "address": "fa:16:3e:5c:d4:cc", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ca89c7-5e", "ovs_interfaceid": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448698.050549) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:04:58.052435 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:04:58.053356 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:04:58.054248 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:04:58.054465 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:04:58.055605 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:04:58.056018 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:04:58.056155 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:04:58.056275 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:04:58.056389 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:04:58.056509 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:04:58.056646 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:04:58.056743 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:04:58.057065 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:04:58.057283 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:04:58.057465 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:04:58.057645 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:04:58.075092 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-751623019-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-testmultiattachvolumeswap-server-751623019-1',id=7,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIoKC/hBS6y4mWYEV0KZGx92EtSh5A6vBfJ/tJKRNkXEEhJQmefIjtTB99y6u7LZ5KXQcYbDAiY9iUqtsaSMO3+X0lq5+bhVt0n8r+qjB2CaNerAmiAR4lZiEx+64qLpw==',key_name='tempest-keypair-895713609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='497a75226ead41d0b5de0b5e17c7c55c',ramdisk_id='',reservation_id='r-4p6dfowh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-2138682875',owner_user_name='tempest-TestMultiAttachVolumeSwap-2138682875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f245211bf5994e21bfe59c811ea624a0',uuid=f448afac-6687-4a4a-84ff-b4478c316986,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "address": "fa:16:3e:5c:d4:cc", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ca89c7-5e", "ovs_interfaceid": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:04:58.075325 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Converting VIF {"id": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "address": "fa:16:3e:5c:d4:cc", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ca89c7-5e", "ovs_interfaceid": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:58.075932 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:d4:cc,bridge_name='br-int',has_traffic_filtering=True,id=c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ca89c7-5e') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:58.076500 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lazy-loading 'pci_devices' on Instance uuid f448afac-6687-4a4a-84ff-b4478c316986 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:04:58.248053 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Successfully updated port: d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:04:58.317474 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-66dcafac-3596-41fc-b022-ef96b2d3e32e req-2ee328ed-35d5-4feb-914b-4a1c04607190 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Received event network-changed-d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:58.317474 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-66dcafac-3596-41fc-b022-ef96b2d3e32e req-2ee328ed-35d5-4feb-914b-4a1c04607190 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Refreshing instance network info cache due to event network-changed-d20d1283-77a1-445e-ae92-60ef3ff039d5. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:04:58.317474 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-66dcafac-3596-41fc-b022-ef96b2d3e32e req-2ee328ed-35d5-4feb-914b-4a1c04607190 service nova] Acquiring lock "refresh_cache-2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:58.317474 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-66dcafac-3596-41fc-b022-ef96b2d3e32e req-2ee328ed-35d5-4feb-914b-4a1c04607190 service nova] Acquired lock "refresh_cache-2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:58.317474 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-66dcafac-3596-41fc-b022-ef96b2d3e32e req-2ee328ed-35d5-4feb-914b-4a1c04607190 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Refreshing network info cache for port d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:04:58.461272 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:58.470113 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:04:58.471401 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:04:58.512990 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84e04b0c-b13c-4cbe-901f-949d08d4b60c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "51db6d36-20a9-4490-9210-1469eae21d03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 25.119s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:58.524890 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.897s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] End _get_guest_xml xml= Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: f448afac-6687-4a4a-84ff-b4478c316986 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: instance-00000007 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: 196608 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: tempest-TestMultiAttachVolumeSwap-server-751623019-1 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: 2026-06-03 01:04:58 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: 192 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: True Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: bare Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: 0 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: virtio Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: tempest-TestMultiAttachVolumeSwap-2138682875-project-member Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: tempest-TestMultiAttachVolumeSwap-2138682875 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: f448afac-6687-4a4a-84ff-b4478c316986 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: f448afac-6687-4a4a-84ff-b4478c316986 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: hvm Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: 128 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: 1 Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: Jun 03 01:04:58.579704 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:04:58.582260 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Preparing to wait for external event network-vif-plugged-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:04:58.582452 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "f448afac-6687-4a4a-84ff-b4478c316986-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:58.582682 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:58.582854 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:58.583706 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-751623019-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-testmultiattachvolumeswap-server-751623019-1',id=7,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIoKC/hBS6y4mWYEV0KZGx92EtSh5A6vBfJ/tJKRNkXEEhJQmefIjtTB99y6u7LZ5KXQcYbDAiY9iUqtsaSMO3+X0lq5+bhVt0n8r+qjB2CaNerAmiAR4lZiEx+64qLpw==',key_name='tempest-keypair-895713609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='497a75226ead41d0b5de0b5e17c7c55c',ramdisk_id='',reservation_id='r-4p6dfowh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-2138682875',owner_user_name='tempest-TestMultiAttachVolumeSwap-2138682875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f245211bf5994e21bfe59c811ea624a0',uuid=f448afac-6687-4a4a-84ff-b4478c316986,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "address": "fa:16:3e:5c:d4:cc", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ca89c7-5e", "ovs_interfaceid": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:04:58.583901 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Converting VIF {"id": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "address": "fa:16:3e:5c:d4:cc", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ca89c7-5e", "ovs_interfaceid": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:04:58.584656 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:d4:cc,bridge_name='br-int',has_traffic_filtering=True,id=c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ca89c7-5e') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:04:58.584959 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:d4:cc,bridge_name='br-int',has_traffic_filtering=True,id=c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ca89c7-5e') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:04:58.585335 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:58.585569 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:58.585766 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:04:58.587816 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:58.587816 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f952f99-ee6a-5f96-8006-9c8556a1c5dd', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:58.594929 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:58.595724 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:58.596006 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:04:58.603208 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:58.608431 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:58.608648 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9ca89c7-5e, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:58.608958 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9ca89c7-5e, col_values=(('qos', UUID('30eb251e-33c7-4674-bc5b-0822a7339b4c')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:58.609129 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9ca89c7-5e, col_values=(('external_ids', {'iface-id': 'c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:d4:cc', 'vm-uuid': 'f448afac-6687-4a4a-84ff-b4478c316986'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:04:58.610194 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:58.611338 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:04:58.626464 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:58.626464 np0000002000 nova-compute[98288]: INFO os_vif [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:d4:cc,bridge_name='br-int',has_traffic_filtering=True,id=c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ca89c7-5e') Jun 03 01:04:58.629955 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:04:58.636820 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:04:58.640499 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Creating image(s) Jun 03 01:04:58.645883 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Creating config drive at /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk.config Jun 03 01:04:58.646219 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:58.646386 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "/opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:58.647750 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "/opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:58.648864 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:58.654776 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:58.656412 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:58.671971 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0tepuobv {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:58.723160 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0tepuobv" returned: 0 in 0.053s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:58.727858 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.071s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:58.728365 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:58.729334 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:58.729334 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:58.733782 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:04:58.734076 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:58.754072 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "refresh_cache-2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:04:58.802562 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.067s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:58.802562 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:58.819565 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-66dcafac-3596-41fc-b022-ef96b2d3e32e req-2ee328ed-35d5-4feb-914b-4a1c04607190 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:04:58.844069 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk 1073741824" returned: 0 in 0.042s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:58.844069 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.115s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:58.844069 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:58.935230 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.090s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:58.935230 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:04:58.937227 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:04:58.955834 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-66dcafac-3596-41fc-b022-ef96b2d3e32e req-2ee328ed-35d5-4feb-914b-4a1c04607190 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:04:58.974480 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:04:58.974538 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] VM Resumed (Lifecycle Event) Jun 03 01:04:59.002808 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:04:59.004163 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Cannot resize image /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:04:59.004163 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:04:59.004163 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Ensure instance console log exists: /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:04:59.004163 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:59.004163 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:59.004351 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:59.172473 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-66dcafac-3596-41fc-b022-ef96b2d3e32e req-2ee328ed-35d5-4feb-914b-4a1c04607190 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:04:59.214598 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:59.245272 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:59.272213 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:59.275756 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:59.346102 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:59.455119 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-27afaa07-3a2e-43b5-9e9c-5077373bd0b6 req-3347bcfb-880d-459e-a7e9-e53536280cdc service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Received event network-vif-plugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:59.455398 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-27afaa07-3a2e-43b5-9e9c-5077373bd0b6 req-3347bcfb-880d-459e-a7e9-e53536280cdc service nova] Acquiring lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:59.457922 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-27afaa07-3a2e-43b5-9e9c-5077373bd0b6 req-3347bcfb-880d-459e-a7e9-e53536280cdc service nova] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:59.458086 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-27afaa07-3a2e-43b5-9e9c-5077373bd0b6 req-3347bcfb-880d-459e-a7e9-e53536280cdc service nova] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:59.458230 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-27afaa07-3a2e-43b5-9e9c-5077373bd0b6 req-3347bcfb-880d-459e-a7e9-e53536280cdc service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Processing event network-vif-plugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:04:59.481245 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:04:59.488222 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:04:59.555413 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5489cf0c-2863-4f39-9195-c3fa2536c7f3 req-478254c5-48f0-46c5-a478-3c1e06c80818 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:59.555628 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5489cf0c-2863-4f39-9195-c3fa2536c7f3 req-478254c5-48f0-46c5-a478-3c1e06c80818 service nova] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:59.555778 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5489cf0c-2863-4f39-9195-c3fa2536c7f3 req-478254c5-48f0-46c5-a478-3c1e06c80818 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:59.555906 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5489cf0c-2863-4f39-9195-c3fa2536c7f3 req-478254c5-48f0-46c5-a478-3c1e06c80818 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:59.556044 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5489cf0c-2863-4f39-9195-c3fa2536c7f3 req-478254c5-48f0-46c5-a478-3c1e06c80818 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Processing event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:04:59.556175 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5489cf0c-2863-4f39-9195-c3fa2536c7f3 req-478254c5-48f0-46c5-a478-3c1e06c80818 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:04:59.556289 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5489cf0c-2863-4f39-9195-c3fa2536c7f3 req-478254c5-48f0-46c5-a478-3c1e06c80818 service nova] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:04:59.556409 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5489cf0c-2863-4f39-9195-c3fa2536c7f3 req-478254c5-48f0-46c5-a478-3c1e06c80818 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:04:59.556876 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5489cf0c-2863-4f39-9195-c3fa2536c7f3 req-478254c5-48f0-46c5-a478-3c1e06c80818 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:04:59.557486 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5489cf0c-2863-4f39-9195-c3fa2536c7f3 req-478254c5-48f0-46c5-a478-3c1e06c80818 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] No waiting events found dispatching network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:04:59.557486 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-5489cf0c-2863-4f39-9195-c3fa2536c7f3 req-478254c5-48f0-46c5-a478-3c1e06c80818 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received unexpected event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 for instance with vm_state building and task_state spawning. Jun 03 01:04:59.560515 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Instance event wait completed in 7 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:04:59.565362 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:04:59.570676 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Instance spawned successfully. Jun 03 01:04:59.571053 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:04:59.593717 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:59.600958 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:59.609252 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:59.626180 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:59.633057 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:04:59.674689 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-66dcafac-3596-41fc-b022-ef96b2d3e32e req-2ee328ed-35d5-4feb-914b-4a1c04607190 service nova] Releasing lock "refresh_cache-2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:04:59.675124 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquired lock "refresh_cache-2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:04:59.675352 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:04:59.992595 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:04:59.992748 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] VM Started (Lifecycle Event) Jun 03 01:05:00.023164 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:05:00.026913 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:05:00.030225 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Instance spawned successfully. Jun 03 01:05:00.030679 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:05:00.080674 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:00.080866 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:00.081239 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:00.082333 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:00.085599 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:00.085782 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:00.155027 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:00.155027 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:00.155102 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No VIF found with MAC fa:16:3e:5c:d4:cc, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:05:00.158055 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Using config drive Jun 03 01:05:00.264616 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:05:00.384512 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "51db6d36-20a9-4490-9210-1469eae21d03" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:00.385048 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "51db6d36-20a9-4490-9210-1469eae21d03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:00.493029 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:00.496008 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:00.498537 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:00.498670 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] VM Paused (Lifecycle Event) Jun 03 01:05:00.538506 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:00.538506 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:00.538506 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:00.538506 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:00.538651 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:00.538901 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:00.594766 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Took 16.89 seconds to spawn the instance on the hypervisor. Jun 03 01:05:00.595122 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:00.634107 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Updating instance_info_cache with network_info: [{"id": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "address": "fa:16:3e:7f:c1:07", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d1283-77", "ovs_interfaceid": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:00.661907 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:00.815463 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Creating config drive at /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk.config Jun 03 01:05:00.822460 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4j5dz7j4 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:00.850225 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4j5dz7j4" returned: 0 in 0.030s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:00.890376 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lazy-loading 'flavor' on Instance uuid 51db6d36-20a9-4490-9210-1469eae21d03 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:01.001331 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:01.007923 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:01.046349 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Took 7.55 seconds to spawn the instance on the hypervisor. Jun 03 01:05:01.046349 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:01.109257 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Took 22.31 seconds to build instance. Jun 03 01:05:01.137138 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Releasing lock "refresh_cache-2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:01.137138 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Instance network_info: |[{"id": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "address": "fa:16:3e:7f:c1:07", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d1283-77", "ovs_interfaceid": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:05:01.138923 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Start _get_guest_xml network_info=[{"id": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "address": "fa:16:3e:7f:c1:07", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d1283-77", "ovs_interfaceid": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:05:01.141095 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:05:01.142280 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-751623019-2', uuid='2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5'), owner=OwnerMeta(userid='f245211bf5994e21bfe59c811ea624a0', username='tempest-TestMultiAttachVolumeSwap-2138682875-project-member', projectid='497a75226ead41d0b5de0b5e17c7c55c', projectname='tempest-TestMultiAttachVolumeSwap-2138682875'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "address": "fa:16:3e:7f:c1:07", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d1283-77", "ovs_interfaceid": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448701.1419406) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:05:01.143360 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:05:01.143799 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:05:01.144621 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:05:01.144833 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:05:01.145700 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:05:01.146027 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:05:01.146210 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:05:01.146351 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:05:01.146551 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:05:01.146674 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:05:01.146809 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:05:01.147001 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:05:01.147139 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:05:01.147292 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:05:01.147481 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:05:01.147642 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:05:01.157632 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-751623019-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-testmultiattachvolumeswap-server-751623019-2',id=8,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIoKC/hBS6y4mWYEV0KZGx92EtSh5A6vBfJ/tJKRNkXEEhJQmefIjtTB99y6u7LZ5KXQcYbDAiY9iUqtsaSMO3+X0lq5+bhVt0n8r+qjB2CaNerAmiAR4lZiEx+64qLpw==',key_name='tempest-keypair-895713609',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='497a75226ead41d0b5de0b5e17c7c55c',ramdisk_id='',reservation_id='r-4p6dfowh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-2138682875',owner_user_name='tempest-TestMultiAttachVolumeSwap-2138682875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f245211bf5994e21bfe59c811ea624a0',uuid=2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "address": "fa:16:3e:7f:c1:07", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d1283-77", "ovs_interfaceid": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:05:01.157878 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Converting VIF {"id": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "address": "fa:16:3e:7f:c1:07", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d1283-77", "ovs_interfaceid": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:05:01.158492 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c1:07,bridge_name='br-int',has_traffic_filtering=True,id=d20d1283-77a1-445e-ae92-60ef3ff039d5,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d1283-77') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:05:01.158942 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:01.253611 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:01.274948 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:01.404795 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:01.517613 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:05:01.517939 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:01.518205 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] VM Resumed (Lifecycle Event) Jun 03 01:05:01.567065 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Took 14.37 seconds to build instance. Jun 03 01:05:01.611229 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3adc1d26-664f-4715-9c5a-4959a293b111 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.822s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] End _get_guest_xml xml= Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: instance-00000008 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 196608 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: tempest-TestMultiAttachVolumeSwap-server-751623019-2 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 2026-06-03 01:05:01 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 192 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: True Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: bare Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: virtio Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: tempest-TestMultiAttachVolumeSwap-2138682875-project-member Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: tempest-TestMultiAttachVolumeSwap-2138682875 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: hvm Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 128 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: Jun 03 01:05:01.661455 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:05:01.663529 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Preparing to wait for external event network-vif-plugged-d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:05:01.663529 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:01.663529 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:01.663529 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:01.663529 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-751623019-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-testmultiattachvolumeswap-server-751623019-2',id=8,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIoKC/hBS6y4mWYEV0KZGx92EtSh5A6vBfJ/tJKRNkXEEhJQmefIjtTB99y6u7LZ5KXQcYbDAiY9iUqtsaSMO3+X0lq5+bhVt0n8r+qjB2CaNerAmiAR4lZiEx+64qLpw==',key_name='tempest-keypair-895713609',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='497a75226ead41d0b5de0b5e17c7c55c',ramdisk_id='',reservation_id='r-4p6dfowh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-2138682875',owner_user_name='tempest-TestMultiAttachVolumeSwap-2138682875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:04:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f245211bf5994e21bfe59c811ea624a0',uuid=2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "address": "fa:16:3e:7f:c1:07", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d1283-77", "ovs_interfaceid": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:05:01.663761 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Converting VIF {"id": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "address": "fa:16:3e:7f:c1:07", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d1283-77", "ovs_interfaceid": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:05:01.663761 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c1:07,bridge_name='br-int',has_traffic_filtering=True,id=d20d1283-77a1-445e-ae92-60ef3ff039d5,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d1283-77') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:05:01.663761 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c1:07,bridge_name='br-int',has_traffic_filtering=True,id=d20d1283-77a1-445e-ae92-60ef3ff039d5,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d1283-77') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:05:01.666008 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:01.666008 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:01.666194 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:01.666552 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:05:01.666769 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:01.678226 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:01.681455 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b23c5d9-b6b9-50fb-8ab3-3497413f195d', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:01.686764 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:01.686764 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:05:01.691232 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:01.698249 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:01.698249 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd20d1283-77, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:01.698249 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd20d1283-77, col_values=(('qos', UUID('10da92e2-0977-441b-89c2-db11b8283462')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:01.698249 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd20d1283-77, col_values=(('external_ids', {'iface-id': 'd20d1283-77a1-445e-ae92-60ef3ff039d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:c1:07', 'vm-uuid': '2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:01.699729 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:01.703013 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:05:01.705425 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:01.707087 np0000002000 nova-compute[98288]: INFO os_vif [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:c1:07,bridge_name='br-int',has_traffic_filtering=True,id=d20d1283-77a1-445e-ae92-60ef3ff039d5,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d1283-77') Jun 03 01:05:01.899882 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bdcf5ace-b3aa-4df3-8a0e-d8167e3dbafb req-a6bbb698-6e6f-4b65-9803-4aa6718dc152 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Received event network-vif-plugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:01.899882 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bdcf5ace-b3aa-4df3-8a0e-d8167e3dbafb req-a6bbb698-6e6f-4b65-9803-4aa6718dc152 service nova] Acquiring lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:01.899882 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bdcf5ace-b3aa-4df3-8a0e-d8167e3dbafb req-a6bbb698-6e6f-4b65-9803-4aa6718dc152 service nova] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:01.899882 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bdcf5ace-b3aa-4df3-8a0e-d8167e3dbafb req-a6bbb698-6e6f-4b65-9803-4aa6718dc152 service nova] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:01.899882 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bdcf5ace-b3aa-4df3-8a0e-d8167e3dbafb req-a6bbb698-6e6f-4b65-9803-4aa6718dc152 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] No waiting events found dispatching network-vif-plugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:01.899882 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-bdcf5ace-b3aa-4df3-8a0e-d8167e3dbafb req-a6bbb698-6e6f-4b65-9803-4aa6718dc152 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Received unexpected event network-vif-plugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 for instance with vm_state active and task_state None. Jun 03 01:05:01.899882 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "51db6d36-20a9-4490-9210-1469eae21d03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.515s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:02.024296 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:02.027505 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:02.070863 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-26a8ccf9-1c83-468b-9e1f-4632afd9ccdb tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.877s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:02.160476 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:02.160723 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:02.180479 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Acquiring lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:02.180744 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:02.180924 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Acquiring lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:02.181042 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:02.181146 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:02.184622 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Terminating instance Jun 03 01:05:02.530287 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:02.530287 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] VM Started (Lifecycle Event) Jun 03 01:05:02.662995 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:05:02.686519 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:05:02.718721 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:02.721835 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:02.738058 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:02.747884 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:02.773164 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:02.788619 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:03.015739 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Instance destroyed successfully. Jun 03 01:05:03.016230 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lazy-loading 'resources' on Instance uuid 77723037-3c0b-4a83-8cf1-6fc0fe05865d {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:03.033952 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:03.035688 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:03.228210 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:03.228423 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:03.228613 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No VIF found with MAC fa:16:3e:7f:c1:07, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:05:03.229185 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Using config drive Jun 03 01:05:03.256384 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:03.256707 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:03.259970 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:05:03.260202 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Claim successful on node np0000002000 Jun 03 01:05:03.519743 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1084391048',display_name='tempest-VolumesAdminNegativeTest-server-1084391048',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-volumesadminnegativetest-server-1084391048',id=4,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-03T01:04:57Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='7bc0ed1bedf94d06a59a244c072d0817',ramdisk_id='',reservation_id='r-e56v0x6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1180237631',owner_user_name='tempest-VolumesAdminNegativeTest-1180237631-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:04:58Z,user_data=None,user_id='919e5ce0d0474509a9ba016ac3d78c9e',uuid=77723037-3c0b-4a83-8cf1-6fc0fe05865d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "549d188f-74a8-441d-b508-47e2e9d0033f", "address": "fa:16:3e:a0:59:a3", "network": {"id": "907bf255-961f-4cc7-88f3-bea77257bee9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-772968330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7bc0ed1bedf94d06a59a244c072d0817", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap549d188f-74", "ovs_interfaceid": "549d188f-74a8-441d-b508-47e2e9d0033f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:05:03.519743 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Converting VIF {"id": "549d188f-74a8-441d-b508-47e2e9d0033f", "address": "fa:16:3e:a0:59:a3", "network": {"id": "907bf255-961f-4cc7-88f3-bea77257bee9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-772968330-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7bc0ed1bedf94d06a59a244c072d0817", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap549d188f-74", "ovs_interfaceid": "549d188f-74a8-441d-b508-47e2e9d0033f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:05:03.519921 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:59:a3,bridge_name='br-int',has_traffic_filtering=True,id=549d188f-74a8-441d-b508-47e2e9d0033f,network=Network(907bf255-961f-4cc7-88f3-bea77257bee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap549d188f-74') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:05:03.519984 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:59:a3,bridge_name='br-int',has_traffic_filtering=True,id=549d188f-74a8-441d-b508-47e2e9d0033f,network=Network(907bf255-961f-4cc7-88f3-bea77257bee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap549d188f-74') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:05:03.522837 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:03.523149 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap549d188f-74, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:03.524467 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:03.525706 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:05:03.530169 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:03.532310 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:03.532767 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6a88f42-cca5-4d61-b670-c0c9f2765177) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:03.534862 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:03.534862 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:05:03.537566 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:03.537798 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] VM Paused (Lifecycle Event) Jun 03 01:05:03.541353 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:03.543591 np0000002000 nova-compute[98288]: INFO os_vif [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:59:a3,bridge_name='br-int',has_traffic_filtering=True,id=549d188f-74a8-441d-b508-47e2e9d0033f,network=Network(907bf255-961f-4cc7-88f3-bea77257bee9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap549d188f-74') Jun 03 01:05:03.543846 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Deleting instance files /opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d_del Jun 03 01:05:03.545978 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Deletion of /opt/stack/data/nova/instances/77723037-3c0b-4a83-8cf1-6fc0fe05865d_del complete Jun 03 01:05:03.557461 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "51db6d36-20a9-4490-9210-1469eae21d03" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:03.557626 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "51db6d36-20a9-4490-9210-1469eae21d03" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:03.557842 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Attaching volume fe7c96d1-2ba1-4c1f-b724-3a49de416d53 to /dev/vdb Jun 03 01:05:03.622592 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:03.623234 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmps18n6iud/privsep.sock'] Jun 03 01:05:03.632432 np0000002000 sudo[110707]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmps18n6iud/privsep.sock Jun 03 01:05:03.633065 np0000002000 sudo[110707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 03 01:05:03.739824 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:03.742384 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:03.742594 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:03.876291 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Creating config drive at /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk.config Jun 03 01:05:03.877982 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 03 01:05:03.877982 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 03 01:05:03.877982 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 03 01:05:03.877982 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Jun 03 01:05:03.878284 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 03 01:05:03.878463 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 03 01:05:03.878619 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 03 01:05:03.878872 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Jun 03 01:05:03.878872 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 03 01:05:03.880882 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpztnc5qgl {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:03.925716 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-96bb5370-b700-4772-af80-51ac1b4f5341 req-539d5c34-9709-4005-b93e-aa799372dc78 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Received event network-changed-384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:03.926022 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-96bb5370-b700-4772-af80-51ac1b4f5341 req-539d5c34-9709-4005-b93e-aa799372dc78 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Refreshing instance network info cache due to event network-changed-384a12cb-fb42-4a82-8fa4-e199eb9c4675. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:05:03.926363 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-96bb5370-b700-4772-af80-51ac1b4f5341 req-539d5c34-9709-4005-b93e-aa799372dc78 service nova] Acquiring lock "refresh_cache-9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:03.926619 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-96bb5370-b700-4772-af80-51ac1b4f5341 req-539d5c34-9709-4005-b93e-aa799372dc78 service nova] Acquired lock "refresh_cache-9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:03.926873 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-96bb5370-b700-4772-af80-51ac1b4f5341 req-539d5c34-9709-4005-b93e-aa799372dc78 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Refreshing network info cache for port 384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:05:03.933338 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpztnc5qgl" returned: 0 in 0.052s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:03.975498 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Received event network-vif-unplugged-549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:03.975756 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] Acquiring lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:03.977067 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:03.977328 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:03.977531 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] No waiting events found dispatching network-vif-unplugged-549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:03.977667 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Received event network-vif-unplugged-549d188f-74a8-441d-b508-47e2e9d0033f for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:05:03.977764 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Received event network-vif-unplugged-549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:03.977885 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] Acquiring lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:03.978005 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:03.978101 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:03.978210 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] No waiting events found dispatching network-vif-unplugged-549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:03.978327 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Received event network-vif-unplugged-549d188f-74a8-441d-b508-47e2e9d0033f for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:05:03.978429 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-changed-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:03.978542 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Refreshing instance network info cache due to event network-changed-9055a094-dc81-45da-9637-48b820c58772. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:05:03.978650 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] Acquiring lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:03.978735 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] Acquired lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:03.978847 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Refreshing network info cache for port 9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:05:04.041345 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:04.046353 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:04.046353 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] VM Resumed (Lifecycle Event) Jun 03 01:05:04.058461 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Took 1.37 seconds to destroy the instance on the hypervisor. Jun 03 01:05:04.059334 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:05:04.059668 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:05:04.059848 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:05:04.060335 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:04.129336 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:04.199123 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 03 01:05:04.199123 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 03 01:05:04.199123 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 03 01:05:04.199123 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Jun 03 01:05:04.199123 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 03 01:05:04.199123 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 03 01:05:04.199123 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 03 01:05:04.199123 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: Jun 03 01:05:04.199123 np0000002000 nova-compute[98288]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 03 01:05:04.245242 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:05:04.384270 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:04.408818 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:04.412839 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:04.430498 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-96bb5370-b700-4772-af80-51ac1b4f5341 req-539d5c34-9709-4005-b93e-aa799372dc78 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:04.482781 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:04.501105 np0000002000 sudo[110707]: pam_unix(sudo:session): session closed for user root Jun 03 01:05:04.502792 np0000002000 nova-compute[98288]: INFO oslo.privsep.daemon [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Spawned new privsep daemon via rootwrap Jun 03 01:05:04.535275 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:04.549128 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:04.556346 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:04.583621 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:04.618787 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:05:04.620122 np0000002000 nova-compute[98288]: WARNING os_brick.initiator.connectors.nvmeof [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jun 03 01:05:04.646310 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:04.670538 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:05:04.671257 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:05:04.688230 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:05:04.689988 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feb8:bd73', 'fe80::fc16:3eff:feee:1536', 'fe80::fc16:3eff:feb8:822', 'fe80::6c:fdff:feee:65b', 'fe80::3c26:53ff:feb3:4c94', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::fc16:3eff:fed9:ee44', 'fe80::10fa:b6ff:fe2c:a1ba', 'fe80::fc16:3eff:fed9:fdf9', 'fe80::489c:41ff:febd:1e4c', 'fe80::fc16:3eff:fe5c:d4cc', 'fe80::34c3:b7ff:fe30:cb04', 'fe80::fc16:3eff:fe7f:c107'] Jun 03 01:05:04.690129 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:05:04.690267 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:05:04.691819 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] <== get_connector_properties: return (1067ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:04.692214 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Updating existing volume attachment record: 3e672eb6-13b5-4825-b4d6-d535886dee59 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:05:04.853256 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:04.887874 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-96bb5370-b700-4772-af80-51ac1b4f5341 req-539d5c34-9709-4005-b93e-aa799372dc78 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:04.973980 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:04.991696 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:05:04.991994 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:05:05.006244 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:05.054136 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-96bb5370-b700-4772-af80-51ac1b4f5341 req-539d5c34-9709-4005-b93e-aa799372dc78 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Updated VIF entry in instance network info cache for port 384a12cb-fb42-4a82-8fa4-e199eb9c4675. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:05:05.054473 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-96bb5370-b700-4772-af80-51ac1b4f5341 req-539d5c34-9709-4005-b93e-aa799372dc78 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Updating instance_info_cache with network_info: [{"id": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "address": "fa:16:3e:d9:fd:f9", "network": {"id": "aca22e29-c397-4c4f-a985-57057a027e42", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-933421303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321c47ec5882416fa2c077d65bcce48c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap384a12cb-fb", "ovs_interfaceid": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:05.058347 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:05.058518 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f448afac-6687-4a4a-84ff-b4478c316986] VM Started (Lifecycle Event) Jun 03 01:05:05.144086 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updated VIF entry in instance network info cache for port 9055a094-dc81-45da-9637-48b820c58772. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:05:05.144371 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updating instance_info_cache with network_info: [{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:05.274474 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:05.274474 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:05.274474 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connector [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Factory for ISCSI on None {{(pid=98288) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 03 01:05:05.274474 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: held 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:05.274474 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:05:05.274474 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:05.274474 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:05.274880 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:05.275604 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:05:05.286896 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:05.288174 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:05.288753 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:05.288973 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:05:05.289335 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:05.289546 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:05:05.299972 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:05:05.299972 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:05.305467 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:05:05.305467 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:05.310498 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53] added Jun 03 01:05:05.310498 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:05:05.310498 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:05.310498 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:05.310498 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:05.310498 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:05.310498 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:05.310677 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:05:05.310810 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0213(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:05:05.310971 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:05:05.313639 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53] added Jun 03 01:05:05.313639 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:05:05.313639 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:05.313639 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:05.313639 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:05.313639 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:05.313639 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:05.313811 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:05:05.314013 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:05:05.314167 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:05:05.477416 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Took 1.42 seconds to deallocate network for instance. Jun 03 01:05:05.495663 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:05:05.556452 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-96bb5370-b700-4772-af80-51ac1b4f5341 req-539d5c34-9709-4005-b93e-aa799372dc78 service nova] Releasing lock "refresh_cache-9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:05.560858 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:05.562022 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:05.562127 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f448afac-6687-4a4a-84ff-b4478c316986] VM Paused (Lifecycle Event) Jun 03 01:05:05.646530 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2549971c-3c60-4e36-8133-81260288b899 req-5c83e019-626a-48db-a2ea-e0eb20d83b9c service nova] Releasing lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:05.752890 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:05:05.753162 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:05:05.753409 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:05:05.753574 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:05:05.753773 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:05:05.753968 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:05:05.754146 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:05:05.754285 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 03 01:05:05.754447 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:05:05.986428 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:06.007151 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.750s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:06.009281 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.156s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:06.009372 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:05:06.018628 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:05:06.018628 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Claim successful on node np0000002000 Jun 03 01:05:06.032006 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2dcd8d7b-0ae9-4f44-9cb9-3e9d99a4a978 req-7660a2e4-24f3-4f33-9985-52c68c11b187 service nova] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Received event network-vif-deleted-549d188f-74a8-441d-b508-47e2e9d0033f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:06.064138 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:06.067492 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:06.260492 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:06.311346 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:05:06.314510 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:06.325740 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:06.333159 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:06.337592 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:06.343689 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:06.348289 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 03 01:05:06.348289 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:06.348474 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 03 01:05:06.348474 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:06.348623 np0000002000 nova-compute[98288]: WARNING os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 03 01:05:06.348623 np0000002000 nova-compute[98288]: Jun 03 01:05:06.353620 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 03 01:05:06.353620 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:06.353828 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 03 01:05:06.353828 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:06.353924 np0000002000 nova-compute[98288]: WARNING os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 03 01:05:06.353924 np0000002000 nova-compute[98288]: Jun 03 01:05:06.515602 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:05:06.516175 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:05:06.516501 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:06.516786 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:06.569348 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f448afac-6687-4a4a-84ff-b4478c316986] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:05:06.569925 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999650470999995 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:06.570312 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999285783999994 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:06.570710 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:06.570886 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998670016000005 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:06.571054 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] VM Started (Lifecycle Event) Jun 03 01:05:06.588095 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a97328826b194121a85a35b41129c1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d71b7749b9b414ea4fb3ad943aebf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:05:06.938433 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Successfully created port: 6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:05:07.020942 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:05:07.075458 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:07.076145 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:07.076301 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] VM Paused (Lifecycle Event) Jun 03 01:05:07.389620 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53, portal: 192.168.50.100,3260] Jun 03 01:05:07.389620 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53, portal: 192.168.50.100,3260] successful. Jun 03 01:05:07.389620 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:07.396081 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53, portal: 192.168.40.100,3260] Jun 03 01:05:07.396081 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53, portal: 192.168.40.100,3260] successful. Jun 03 01:05:07.396081 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:07.400372 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:07.406850 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:07.414739 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Successfully updated port: 6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:05:07.416910 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 (non-flash) Jun 03 01:05:07.416910 np0000002000 nova-compute[98288]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 (non-flash) Jun 03 01:05:07.416910 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:07.416910 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsi session list stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 (non-flash) Jun 03 01:05:07.416910 np0000002000 nova-compute[98288]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 (non-flash) Jun 03 01:05:07.416910 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:07.417109 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.128s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:07.420258 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:07.422352 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 (non-flash) Jun 03 01:05:07.422352 np0000002000 nova-compute[98288]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 (non-flash) Jun 03 01:05:07.422352 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:07.422352 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsi session list stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 (non-flash) Jun 03 01:05:07.422352 np0000002000 nova-compute[98288]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 (non-flash) Jun 03 01:05:07.422352 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:07.422352 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.134s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:07.422604 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:07.423736 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] HCTL ('7', '-', '-', 0) found on session 1 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:07.425272 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:07.427561 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] HCTL ('8', '-', '-', 0) found on session 2 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:07.427561 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:07.445683 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Searching for a device in session 1 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:07.445683 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:07.446803 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Searching for a device in session 2 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:07.446996 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:07.493421 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d105ba9c-98c8-4ec9-ab29-f3e5c3771880 req-2f98bfc9-5cd6-44c6-a51a-f658c839db33 service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-changed-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:07.493593 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d105ba9c-98c8-4ec9-ab29-f3e5c3771880 req-2f98bfc9-5cd6-44c6-a51a-f658c839db33 service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Refreshing instance network info cache due to event network-changed-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:05:07.494684 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d105ba9c-98c8-4ec9-ab29-f3e5c3771880 req-2f98bfc9-5cd6-44c6-a51a-f658c839db33 service nova] Acquiring lock "refresh_cache-cbb3ba9a-f26f-40c4-ac5b-00470740fd96" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:07.494794 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d105ba9c-98c8-4ec9-ab29-f3e5c3771880 req-2f98bfc9-5cd6-44c6-a51a-f658c839db33 service nova] Acquired lock "refresh_cache-cbb3ba9a-f26f-40c4-ac5b-00470740fd96" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:07.496660 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-d105ba9c-98c8-4ec9-ab29-f3e5c3771880 req-2f98bfc9-5cd6-44c6-a51a-f658c839db33 service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Refreshing network info cache for port 6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:05:07.524941 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:05:07.546575 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:05:07.546789 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:05:07.579217 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:07.581642 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:07.802940 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:07.921065 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "refresh_cache-cbb3ba9a-f26f-40c4-ac5b-00470740fd96" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:07.998523 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-d105ba9c-98c8-4ec9-ab29-f3e5c3771880 req-2f98bfc9-5cd6-44c6-a51a-f658c839db33 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:08.052386 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:05:08.083326 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-d105ba9c-98c8-4ec9-ab29-f3e5c3771880 req-2f98bfc9-5cd6-44c6-a51a-f658c839db33 service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:05:08.085269 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:05:08.273335 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-d105ba9c-98c8-4ec9-ab29-f3e5c3771880 req-2f98bfc9-5cd6-44c6-a51a-f658c839db33 service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:08.289453 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:05:08.534223 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:08.541682 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:05:08.542636 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:05:08.542870 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Creating image(s) Jun 03 01:05:08.543721 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:08.543810 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "/opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:08.544186 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "/opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:08.544705 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:08.548337 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:08.550513 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:08.565648 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.556s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:08.567454 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.580s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:08.567454 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:05:08.630593 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.080s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:08.630593 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:08.631029 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:08.631223 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:08.633702 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:08.633989 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:08.695358 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.060s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:08.695358 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:08.732565 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk 1073741824" returned: 0 in 0.037s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:08.734015 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.102s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:08.734015 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:08.776246 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d105ba9c-98c8-4ec9-ab29-f3e5c3771880 req-2f98bfc9-5cd6-44c6-a51a-f658c839db33 service nova] Releasing lock "refresh_cache-cbb3ba9a-f26f-40c4-ac5b-00470740fd96" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:08.776871 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquired lock "refresh_cache-cbb3ba9a-f26f-40c4-ac5b-00470740fd96" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:08.777115 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:05:08.804472 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.070s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:08.806113 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:05:08.806113 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:08.903315 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:08.904136 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Cannot resize image /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:05:08.905379 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:05:08.905379 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Ensure instance console log exists: /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:05:08.905379 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:08.905379 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:08.905379 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:09.080863 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:05:09.081101 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:05:09.081591 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:09.081899 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:09.119465 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:05:09.119827 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:05:09.162880 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a97328826b194121a85a35b41129c1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d71b7749b9b414ea4fb3ad943aebf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:05:09.304996 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Found WWN 33000000087ed8df5 for multipath device dm-0 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:05:09.305597 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.031s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:09.305755 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] <== connect_volume: return (4032ms) {'type': 'block', 'scsi_wwn': '33000000087ed8df5', 'path': '/dev/dm-0', 'multipath_id': '33000000087ed8df5'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:09.305903 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000087ed8df5', 'path': '/dev/dm-0', 'multipath_id': '33000000087ed8df5'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:05:09.308037 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lazy-loading 'flavor' on Instance uuid 51db6d36-20a9-4490-9210-1469eae21d03 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:09.385480 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:05:09.583433 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:05:09.591298 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Received event network-vif-unplugged-1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:09.591848 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Acquiring lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:09.592025 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:09.592227 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:09.592415 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] No event matching network-vif-unplugged-1d295ed9-260a-4fd7-a169-b87add358744 in dict_keys([('network-vif-plugged', '1d295ed9-260a-4fd7-a169-b87add358744')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:05:09.592624 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Received unexpected event network-vif-unplugged-1d295ed9-260a-4fd7-a169-b87add358744 for instance with vm_state building and task_state spawning. Jun 03 01:05:09.592749 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Received event network-vif-unplugged-6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:09.592920 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Acquiring lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:09.593075 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:09.593241 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:09.593390 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] No event matching network-vif-unplugged-6a705171-4b6c-45df-ac14-46862c313924 in dict_keys([('network-vif-plugged', '6a705171-4b6c-45df-ac14-46862c313924')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:05:09.593564 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Received unexpected event network-vif-unplugged-6a705171-4b6c-45df-ac14-46862c313924 for instance with vm_state building and task_state spawning. Jun 03 01:05:09.593724 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Received event network-vif-plugged-1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:09.593900 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Acquiring lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:09.594057 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:09.595197 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:09.595197 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Processing event network-vif-plugged-1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:05:09.596289 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Received event network-vif-plugged-1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:09.596521 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Acquiring lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:09.596718 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:09.596866 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:09.598334 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] No waiting events found dispatching network-vif-plugged-1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:09.601541 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Instance event wait completed in 17 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:05:09.602633 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Successfully created port: d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:05:09.604233 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:09.606779 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Received unexpected event network-vif-plugged-1d295ed9-260a-4fd7-a169-b87add358744 for instance with vm_state building and task_state spawning. Jun 03 01:05:09.608154 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:09.608418 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] VM Resumed (Lifecycle Event) Jun 03 01:05:09.609896 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:05:09.612164 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Instance spawned successfully. Jun 03 01:05:09.612528 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:05:09.613698 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Received event network-vif-unplugged-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:09.613979 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Acquiring lock "f448afac-6687-4a4a-84ff-b4478c316986-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:09.614200 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "f448afac-6687-4a4a-84ff-b4478c316986-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:09.614360 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "f448afac-6687-4a4a-84ff-b4478c316986-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:09.614567 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] No event matching network-vif-unplugged-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 in dict_keys([('network-vif-plugged', 'c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Received unexpected event network-vif-unplugged-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 for instance with vm_state building and task_state spawning. Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Received event network-vif-plugged-6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Acquiring lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Processing event network-vif-plugged-6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Received event network-vif-plugged-6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Acquiring lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] No waiting events found dispatching network-vif-plugged-6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Received unexpected event network-vif-plugged-6a705171-4b6c-45df-ac14-46862c313924 for instance with vm_state building and task_state spawning. Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Received event network-vif-unplugged-d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Acquiring lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:09.618110 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:09.618724 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:09.618724 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] No event matching network-vif-unplugged-d20d1283-77a1-445e-ae92-60ef3ff039d5 in dict_keys([('network-vif-plugged', 'd20d1283-77a1-445e-ae92-60ef3ff039d5')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:05:09.618724 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-7d88cda8-a156-4cc5-a8a6-9b1051414f55 req-a6f4a622-9ff5-41c0-8eb5-35990a01ff88 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Received unexpected event network-vif-unplugged-d20d1283-77a1-445e-ae92-60ef3ff039d5 for instance with vm_state building and task_state spawning. Jun 03 01:05:09.618724 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Instance event wait completed in 11 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:05:09.622606 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:05:09.623303 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:05:09.632919 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Instance spawned successfully. Jun 03 01:05:09.632919 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:05:09.634356 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:09.634692 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:09.634959 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:09.635233 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:09.763875 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Updating instance_info_cache with network_info: [{"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:09.813747 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Attempting to attach volume fe7c96d1-2ba1-4c1f-b724-3a49de416d53 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98288) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 03 01:05:09.815002 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] attach device xml: Jun 03 01:05:09.815002 np0000002000 nova-compute[98288]: Jun 03 01:05:09.815002 np0000002000 nova-compute[98288]: Jun 03 01:05:09.815002 np0000002000 nova-compute[98288]: Jun 03 01:05:09.815002 np0000002000 nova-compute[98288]: Jun 03 01:05:09.815002 np0000002000 nova-compute[98288]: fe7c96d1-2ba1-4c1f-b724-3a49de416d53 Jun 03 01:05:09.815002 np0000002000 nova-compute[98288]: Jun 03 01:05:09.815002 np0000002000 nova-compute[98288]: {{(pid=98288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 03 01:05:10.087104 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:05:10.112658 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:10.119791 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:10.126778 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:10.126778 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:10.126778 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:10.126778 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:10.126778 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:10.126778 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:10.135545 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.568s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:10.135816 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 3.875s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:10.136176 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:10.136343 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Auditing locally available compute resources for np0000002000 (node: np0000002000) {{(pid=98288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 03 01:05:10.140169 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Took 19.12 seconds to spawn the instance on the hypervisor. Jun 03 01:05:10.140331 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:10.185095 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Successfully updated port: d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:05:10.226238 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Deleted allocations for instance 77723037-3c0b-4a83-8cf1-6fc0fe05865d Jun 03 01:05:10.269458 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Releasing lock "refresh_cache-cbb3ba9a-f26f-40c4-ac5b-00470740fd96" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:10.269458 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Instance network_info: |[{"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:05:10.271615 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Start _get_guest_xml network_info=[{"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:05:10.274715 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:05:10.276502 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-912542477', uuid='cbb3ba9a-f26f-40c4-ac5b-00470740fd96'), owner=OwnerMeta(userid='a97328826b194121a85a35b41129c1a9', username='tempest-ServerRescueNegativeTestJSON-335039479-project-member', projectid='8d71b7749b9b414ea4fb3ad943aebf49', projectname='tempest-ServerRescueNegativeTestJSON-335039479'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448710.276004) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:05:10.277360 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:05:10.277763 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:05:10.278921 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:05:10.279100 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:05:10.280219 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:05:10.280648 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:05:10.281131 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:05:10.281131 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:05:10.281131 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:05:10.281356 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:05:10.281669 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:05:10.281823 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:05:10.281936 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:05:10.282043 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:05:10.282153 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:05:10.282260 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:05:10.296717 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-912542477',display_name='tempest-ServerRescueNegativeTestJSON-server-912542477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverrescuenegativetestjson-server-912542477',id=9,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d71b7749b9b414ea4fb3ad943aebf49',ramdisk_id='',reservation_id='r-8e5i10vc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-335039479',owner_user_name='tempest-ServerRescueNegativeTestJSON-335039479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:05:08Z,user_data=None,user_id='a97328826b194121a85a35b41129c1a9',uuid=cbb3ba9a-f26f-40c4-ac5b-00470740fd96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:05:10.296895 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converting VIF {"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:05:10.297655 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:1d:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ca57b5b-fdc0-4f99-a76c-1bf9511024a1,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca57b5b-fd') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:05:10.298366 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'pci_devices' on Instance uuid cbb3ba9a-f26f-40c4-ac5b-00470740fd96 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:10.624300 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:05:10.624575 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:10.624667 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] VM Resumed (Lifecycle Event) Jun 03 01:05:10.630897 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Took 29.16 seconds to spawn the instance on the hypervisor. Jun 03 01:05:10.631130 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:10.656092 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Took 24.85 seconds to build instance. Jun 03 01:05:10.688253 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "refresh_cache-2bdcee06-76d6-431e-bef1-84b1acf1ccca" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:10.688464 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquired lock "refresh_cache-2bdcee06-76d6-431e-bef1-84b1acf1ccca" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:10.688672 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] End _get_guest_xml xml= Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: cbb3ba9a-f26f-40c4-ac5b-00470740fd96 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: instance-00000009 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: 196608 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-server-912542477 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: 2026-06-03 01:05:10 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: 192 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: True Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: bare Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: virtio Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-335039479-project-member Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-335039479 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: cbb3ba9a-f26f-40c4-ac5b-00470740fd96 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: cbb3ba9a-f26f-40c4-ac5b-00470740fd96 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: hvm Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: 128 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: Jun 03 01:05:10.800915 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:05:10.802876 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Preparing to wait for external event network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:05:10.802876 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:10.802876 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:10.802876 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:10.802876 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-912542477',display_name='tempest-ServerRescueNegativeTestJSON-server-912542477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverrescuenegativetestjson-server-912542477',id=9,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d71b7749b9b414ea4fb3ad943aebf49',ramdisk_id='',reservation_id='r-8e5i10vc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-335039479',owner_user_name='tempest-ServerRescueNegativeTestJSON-335039479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:05:08Z,user_data=None,user_id='a97328826b194121a85a35b41129c1a9',uuid=cbb3ba9a-f26f-40c4-ac5b-00470740fd96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:05:10.803137 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converting VIF {"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:05:10.803137 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:1d:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ca57b5b-fdc0-4f99-a76c-1bf9511024a1,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca57b5b-fd') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:05:10.803137 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:1d:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ca57b5b-fdc0-4f99-a76c-1bf9511024a1,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca57b5b-fd') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:05:10.803137 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:10.803502 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:10.803722 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:05:10.804483 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:10.804636 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3c058ed-d6d3-596e-9af3-7f83ef202cc0', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:10.823623 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:10.823623 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:05:10.825868 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:10.826066 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ca57b5b-fd, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:10.826541 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ca57b5b-fd, col_values=(('qos', UUID('c4d58f85-b94e-4c0a-bb94-b1fb50dffe74')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:10.826760 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ca57b5b-fd, col_values=(('external_ids', {'iface-id': '6ca57b5b-fdc0-4f99-a76c-1bf9511024a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:1d:7b', 'vm-uuid': 'cbb3ba9a-f26f-40c4-ac5b-00470740fd96'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:10.828659 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:10.829722 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:05:10.835158 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:10.836510 np0000002000 nova-compute[98288]: INFO os_vif [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:1d:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ca57b5b-fdc0-4f99-a76c-1bf9511024a1,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca57b5b-fd') Jun 03 01:05:11.097457 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:05:11.098238 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:05:11.098457 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Creating image(s) Jun 03 01:05:11.098826 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:11.098984 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "/opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:11.099413 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "/opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:11.101450 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:11.103908 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:11.105493 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:11.130122 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:11.133762 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:11.141068 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Took 36.72 seconds to build instance. Jun 03 01:05:11.157887 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 26.380s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:11.182060 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.076s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:11.182492 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:11.183007 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:11.183405 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:11.186043 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:11.188742 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:11.208424 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:11.242903 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e8127d66-b58d-4a2f-87de-6b27a4de91c1 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Lock "77723037-3c0b-4a83-8cf1-6fc0fe05865d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.061s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:11.282428 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.094s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:11.283496 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:11.297301 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:05:11.300745 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:11.300930 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:11.331071 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk 1073741824" returned: 0 in 0.047s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:11.331692 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.149s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:11.333031 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:11.389745 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:11.392757 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:11.416071 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.084s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:11.416498 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:05:11.416736 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:11.466562 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:11.473182 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:11.492322 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:11.492322 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:11.492322 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:11.492322 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] No VIF found with MAC fa:16:3e:b8:bd:73, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:05:11.502105 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:11.502911 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Cannot resize image /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:05:11.506568 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:05:11.506568 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Ensure instance console log exists: /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:05:11.506568 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:11.506568 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:11.506568 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:11.550466 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:11.567453 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:11.570525 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:11.643360 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3884c48c-5ca1-4c5d-a7f6-901c38f42f6e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 38.247s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:11.650750 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:11.651388 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:11.726234 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fc6a8f3c-c8b5-4b7f-a1c8-a9c36c8e4f5d req-e383415d-46e9-40d3-b913-f9d29aaed26f service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received event network-changed-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:11.726585 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fc6a8f3c-c8b5-4b7f-a1c8-a9c36c8e4f5d req-e383415d-46e9-40d3-b913-f9d29aaed26f service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Refreshing instance network info cache due to event network-changed-d485fb06-fb35-4f18-a724-b98151540d40. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:05:11.726585 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fc6a8f3c-c8b5-4b7f-a1c8-a9c36c8e4f5d req-e383415d-46e9-40d3-b913-f9d29aaed26f service nova] Acquiring lock "refresh_cache-2bdcee06-76d6-431e-bef1-84b1acf1ccca" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:11.737766 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:11.747432 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:11.751190 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:11.851750 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Updating instance_info_cache with network_info: [{"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:11.853655 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:11.854527 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:11.930344 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:11.930344 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} Jun 03 01:05:11.932859 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:12.011331 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:12.011819 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:12.090621 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:12.093575 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:12.160429 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:12.161320 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:12.260556 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:12.263997 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:12.357132 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Releasing lock "refresh_cache-2bdcee06-76d6-431e-bef1-84b1acf1ccca" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:12.359187 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Instance network_info: |[{"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:05:12.359794 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fc6a8f3c-c8b5-4b7f-a1c8-a9c36c8e4f5d req-e383415d-46e9-40d3-b913-f9d29aaed26f service nova] Acquired lock "refresh_cache-2bdcee06-76d6-431e-bef1-84b1acf1ccca" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:12.362097 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Start _get_guest_xml network_info=[{"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:05:12.362734 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:12.362952 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-fc6a8f3c-c8b5-4b7f-a1c8-a9c36c8e4f5d req-e383415d-46e9-40d3-b913-f9d29aaed26f service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Refreshing network info cache for port d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:05:12.368217 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:12.383642 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:05:12.395836 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-933697352', uuid='2bdcee06-76d6-431e-bef1-84b1acf1ccca'), owner=OwnerMeta(userid='a97328826b194121a85a35b41129c1a9', username='tempest-ServerRescueNegativeTestJSON-335039479-project-member', projectid='8d71b7749b9b414ea4fb3ad943aebf49', projectname='tempest-ServerRescueNegativeTestJSON-335039479'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448712.3882897) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:05:12.400089 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:12.400501 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:05:12.401200 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:05:12.401524 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:12.401612 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No VIF found with MAC fa:16:3e:29:1d:7b, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:05:12.402260 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Using config drive Jun 03 01:05:12.404469 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:05:12.404603 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:05:12.406848 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:05:12.407334 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:05:12.407570 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:05:12.407653 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:05:12.407839 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:05:12.407948 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:05:12.408083 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:05:12.409885 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:05:12.410655 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:05:12.411408 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:05:12.411599 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:05:12.411758 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:05:12.429693 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-933697352',display_name='tempest-ServerRescueNegativeTestJSON-server-933697352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverrescuenegativetestjson-server-933697352',id=10,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d71b7749b9b414ea4fb3ad943aebf49',ramdisk_id='',reservation_id='r-4yumn2hi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-335039479',owner_user_name='tempest-ServerRescueNegativeTestJSON-335039479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:05:10Z,user_data=None,user_id='a97328826b194121a85a35b41129c1a9',uuid=2bdcee06-76d6-431e-bef1-84b1acf1ccca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:05:12.429891 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converting VIF {"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:05:12.430668 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:87:e7,bridge_name='br-int',has_traffic_filtering=True,id=d485fb06-fb35-4f18-a724-b98151540d40,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd485fb06-fb') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:05:12.431754 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bdcee06-76d6-431e-bef1-84b1acf1ccca {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:12.453583 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:12.458472 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:05:12.458472 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:12.484843 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "env LANG=C uptime" returned: 0 in 0.026s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:12.486146 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Hypervisor/Node resource view: name=np0000002000 free_ram=13993MB free_disk=74.7009162902832GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 03 01:05:12.486146 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:12.486370 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:12.805337 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:12.883006 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-fc6a8f3c-c8b5-4b7f-a1c8-a9c36c8e4f5d req-e383415d-46e9-40d3-b913-f9d29aaed26f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:12.916376 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] End _get_guest_xml xml= Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 2bdcee06-76d6-431e-bef1-84b1acf1ccca Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: instance-0000000a Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 196608 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-server-933697352 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 2026-06-03 01:05:12 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 192 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: True Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: bare Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: virtio Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-335039479-project-member Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-335039479 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 2bdcee06-76d6-431e-bef1-84b1acf1ccca Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 2bdcee06-76d6-431e-bef1-84b1acf1ccca Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: hvm Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 128 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: Jun 03 01:05:12.938120 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:05:12.939858 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Preparing to wait for external event network-vif-plugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:05:12.939858 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:12.939858 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:12.939858 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:12.940769 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-933697352',display_name='tempest-ServerRescueNegativeTestJSON-server-933697352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverrescuenegativetestjson-server-933697352',id=10,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d71b7749b9b414ea4fb3ad943aebf49',ramdisk_id='',reservation_id='r-4yumn2hi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-335039479',owner_user_name='tempest-ServerRescueNegativeTestJSON-335039479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:05:10Z,user_data=None,user_id='a97328826b194121a85a35b41129c1a9',uuid=2bdcee06-76d6-431e-bef1-84b1acf1ccca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:05:12.942001 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converting VIF {"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:05:12.942610 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:87:e7,bridge_name='br-int',has_traffic_filtering=True,id=d485fb06-fb35-4f18-a724-b98151540d40,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd485fb06-fb') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:05:12.942906 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:87:e7,bridge_name='br-int',has_traffic_filtering=True,id=d485fb06-fb35-4f18-a724-b98151540d40,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd485fb06-fb') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:05:12.943644 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:12.943644 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:12.945969 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:05:12.948874 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:12.949296 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46cec022-d3a9-5c31-b692-c102edec456e', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:12.953050 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:12.954721 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:05:12.959591 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:12.980240 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:12.980527 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd485fb06-fb, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:12.980945 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd485fb06-fb, col_values=(('qos', UUID('5a09b5d9-4ef2-486b-ad5e-4226179fed00')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:12.981191 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd485fb06-fb, col_values=(('external_ids', {'iface-id': 'd485fb06-fb35-4f18-a724-b98151540d40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:87:e7', 'vm-uuid': '2bdcee06-76d6-431e-bef1-84b1acf1ccca'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:12.985516 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:05:13.000464 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:13.001356 np0000002000 nova-compute[98288]: INFO os_vif [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:87:e7,bridge_name='br-int',has_traffic_filtering=True,id=d485fb06-fb35-4f18-a724-b98151540d40,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd485fb06-fb') Jun 03 01:05:13.074945 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0bb1b71f-cf10-4e61-a959-c6ef16e5b5f2 tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "51db6d36-20a9-4490-9210-1469eae21d03" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.517s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:13.085311 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:13.099180 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:13.110319 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Creating config drive at /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.config Jun 03 01:05:13.117687 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4pwabadm {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:13.150888 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4pwabadm" returned: 0 in 0.032s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:13.293929 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-fc6a8f3c-c8b5-4b7f-a1c8-a9c36c8e4f5d req-e383415d-46e9-40d3-b913-f9d29aaed26f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:13.473402 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "51db6d36-20a9-4490-9210-1469eae21d03" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:13.473683 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "51db6d36-20a9-4490-9210-1469eae21d03" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:13.473861 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "51db6d36-20a9-4490-9210-1469eae21d03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:13.474005 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:13.474129 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:13.481283 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Terminating instance Jun 03 01:05:13.497283 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-fc6a8f3c-c8b5-4b7f-a1c8-a9c36c8e4f5d req-e383415d-46e9-40d3-b913-f9d29aaed26f service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Updated VIF entry in instance network info cache for port d485fb06-fb35-4f18-a724-b98151540d40. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:05:13.498478 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-fc6a8f3c-c8b5-4b7f-a1c8-a9c36c8e4f5d req-e383415d-46e9-40d3-b913-f9d29aaed26f service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Updating instance_info_cache with network_info: [{"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:13.578581 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:05:13.578678 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 51db6d36-20a9-4490-9210-1469eae21d03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:05:13.578890 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 1225d1ad-70c5-43e1-b8f0-927efb3ef6be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:05:13.578982 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 697c41c0-3674-4c57-b793-7ab8a4abe82a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:05:13.579104 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:05:13.579212 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance f448afac-6687-4a4a-84ff-b4478c316986 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:05:13.579295 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:05:13.579376 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance cbb3ba9a-f26f-40c4-ac5b-00470740fd96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:05:13.579471 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 2bdcee06-76d6-431e-bef1-84b1acf1ccca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:05:13.579649 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 03 01:05:13.579881 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Final resource view: name=np0000002000 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:05:12 up 28 min, 2 users, load average: 6.68, 3.02, 1.46\n', 'num_instances': '9', 'num_vm_active': '5', 'num_task_None': '4', 'num_os_type_None': '9', 'num_proj_458b2c2a365c46d6adcc9f193597a08a': '1', 'io_workload': '4', 'num_task_image_snapshot_pending': '1', 'num_proj_e3b5c165c8b142b6af1c20eeac918eb0': '1', 'num_proj_64016d71af32442f8c9e0e2fc40a542b': '1', 'num_proj_c789ce874dc544078557d41878b032f2': '1', 'num_proj_321c47ec5882416fa2c077d65bcce48c': '1', 'num_vm_building': '4', 'num_task_spawning': '4', 'num_proj_497a75226ead41d0b5de0b5e17c7c55c': '2', 'num_proj_8d71b7749b9b414ea4fb3ad943aebf49': '2'} {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 03 01:05:13.608744 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] instance snapshotting Jun 03 01:05:13.650463 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:13.678078 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:13.681142 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:13.773827 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Beginning live snapshot process Jun 03 01:05:13.782346 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:13.833505 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d7c08325-d6d1-4210-aaee-9e88a6ecdf85 req-525786ec-075b-41a0-b25f-d00fa0774f07 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Received event network-changed-6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:13.833916 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d7c08325-d6d1-4210-aaee-9e88a6ecdf85 req-525786ec-075b-41a0-b25f-d00fa0774f07 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Refreshing instance network info cache due to event network-changed-6a705171-4b6c-45df-ac14-46862c313924. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:05:13.833916 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d7c08325-d6d1-4210-aaee-9e88a6ecdf85 req-525786ec-075b-41a0-b25f-d00fa0774f07 service nova] Acquiring lock "refresh_cache-697c41c0-3674-4c57-b793-7ab8a4abe82a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:13.833916 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d7c08325-d6d1-4210-aaee-9e88a6ecdf85 req-525786ec-075b-41a0-b25f-d00fa0774f07 service nova] Acquired lock "refresh_cache-697c41c0-3674-4c57-b793-7ab8a4abe82a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:13.834030 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-d7c08325-d6d1-4210-aaee-9e88a6ecdf85 req-525786ec-075b-41a0-b25f-d00fa0774f07 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Refreshing network info cache for port 6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:05:13.996903 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:05:14.003536 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fc6a8f3c-c8b5-4b7f-a1c8-a9c36c8e4f5d req-e383415d-46e9-40d3-b913-f9d29aaed26f service nova] Releasing lock "refresh_cache-2bdcee06-76d6-431e-bef1-84b1acf1ccca" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:14.034725 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.038486 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.062604 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.075074 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.088532 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.091693 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.113808 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.126193 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.269332 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.306708 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.335968 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-d7c08325-d6d1-4210-aaee-9e88a6ecdf85 req-525786ec-075b-41a0-b25f-d00fa0774f07 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:14.374809 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999524920999875 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:14.379131 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Instance destroyed successfully. Jun 03 01:05:14.379388 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lazy-loading 'resources' on Instance uuid 51db6d36-20a9-4490-9210-1469eae21d03 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:14.420745 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:05:14.420940 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:05:14.527468 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:14.527564 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:14.527644 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No VIF found with MAC fa:16:3e:72:87:e7, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:05:14.528065 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Using config drive Jun 03 01:05:14.574383 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c8dc407a-bf2e-432b-8e37-7ca7f8e962e7 req-3a926a4e-b454-451a-80d2-231ba0483faa service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Received event network-vif-unplugged-99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:14.575286 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c8dc407a-bf2e-432b-8e37-7ca7f8e962e7 req-3a926a4e-b454-451a-80d2-231ba0483faa service nova] Acquiring lock "51db6d36-20a9-4490-9210-1469eae21d03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:14.575464 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c8dc407a-bf2e-432b-8e37-7ca7f8e962e7 req-3a926a4e-b454-451a-80d2-231ba0483faa service nova] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:14.575600 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c8dc407a-bf2e-432b-8e37-7ca7f8e962e7 req-3a926a4e-b454-451a-80d2-231ba0483faa service nova] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:14.575737 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c8dc407a-bf2e-432b-8e37-7ca7f8e962e7 req-3a926a4e-b454-451a-80d2-231ba0483faa service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] No waiting events found dispatching network-vif-unplugged-99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:14.575848 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c8dc407a-bf2e-432b-8e37-7ca7f8e962e7 req-3a926a4e-b454-451a-80d2-231ba0483faa service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Received event network-vif-unplugged-99d6fecc-d026-4678-99ce-d8303121f361 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:05:14.659613 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:14.659613 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] VM Started (Lifecycle Event) Jun 03 01:05:14.697651 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-d7c08325-d6d1-4210-aaee-9e88a6ecdf85 req-525786ec-075b-41a0-b25f-d00fa0774f07 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:14.851305 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-d7c08325-d6d1-4210-aaee-9e88a6ecdf85 req-525786ec-075b-41a0-b25f-d00fa0774f07 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Updated VIF entry in instance network info cache for port 6a705171-4b6c-45df-ac14-46862c313924. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:05:14.851305 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-d7c08325-d6d1-4210-aaee-9e88a6ecdf85 req-525786ec-075b-41a0-b25f-d00fa0774f07 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Updating instance_info_cache with network_info: [{"id": "6a705171-4b6c-45df-ac14-46862c313924", "address": "fa:16:3e:d9:ee:44", "network": {"id": "3bbe9fd2-9242-4876-a8e2-e7d15f27293f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890948811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c789ce874dc544078557d41878b032f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a705171-4b", "ovs_interfaceid": "6a705171-4b6c-45df-ac14-46862c313924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:14.881730 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-671409409',display_name='tempest-DeleteServersTestJSON-server-671409409',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-deleteserverstestjson-server-671409409',id=1,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-03T01:04:57Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='458b2c2a365c46d6adcc9f193597a08a',ramdisk_id='',reservation_id='r-zqjfvnky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1608594473',owner_user_name='tempest-DeleteServersTestJSON-1608594473-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:04:58Z,user_data=None,user_id='978123ec500f4f60a735f0f3c59dbf8e',uuid=51db6d36-20a9-4490-9210-1469eae21d03,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99d6fecc-d026-4678-99ce-d8303121f361", "address": "fa:16:3e:b8:bd:73", "network": {"id": "103b91e1-d9d9-478b-9498-4552e42f3160", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106681336-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "458b2c2a365c46d6adcc9f193597a08a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d6fecc-d0", "ovs_interfaceid": "99d6fecc-d026-4678-99ce-d8303121f361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:05:14.884460 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Converting VIF {"id": "99d6fecc-d026-4678-99ce-d8303121f361", "address": "fa:16:3e:b8:bd:73", "network": {"id": "103b91e1-d9d9-478b-9498-4552e42f3160", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1106681336-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "458b2c2a365c46d6adcc9f193597a08a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d6fecc-d0", "ovs_interfaceid": "99d6fecc-d026-4678-99ce-d8303121f361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:05:14.884460 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:bd:73,bridge_name='br-int',has_traffic_filtering=True,id=99d6fecc-d026-4678-99ce-d8303121f361,network=Network(103b91e1-d9d9-478b-9498-4552e42f3160),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d6fecc-d0') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:05:14.884460 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:bd:73,bridge_name='br-int',has_traffic_filtering=True,id=99d6fecc-d026-4678-99ce-d8303121f361,network=Network(103b91e1-d9d9-478b-9498-4552e42f3160),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d6fecc-d0') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:05:14.885634 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.885835 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99d6fecc-d0, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:14.887407 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.889903 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:05:14.892577 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.893490 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.893643 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8630ce3-cfb8-43de-8b41-b3e51ee0f59d) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:14.894161 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.894849 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:05:14.899955 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:14.902217 np0000002000 nova-compute[98288]: INFO os_vif [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:bd:73,bridge_name='br-int',has_traffic_filtering=True,id=99d6fecc-d026-4678-99ce-d8303121f361,network=Network(103b91e1-d9d9-478b-9498-4552e42f3160),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d6fecc-d0') Jun 03 01:05:14.904571 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:05:14.904571 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:14.904571 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:14.904571 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:14.904571 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:05:14.904571 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:05:14.924090 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:05:14.929632 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 (non-flash) Jun 03 01:05:14.929632 np0000002000 nova-compute[98288]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 (non-flash) Jun 03 01:05:14.929632 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:14.931482 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsi session list stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 (non-flash) Jun 03 01:05:14.931482 np0000002000 nova-compute[98288]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53 (non-flash) Jun 03 01:05:14.931482 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:14.931482 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', '1'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', '2')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:05:14.931482 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', '2')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:05:14.931482 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53', '1')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:05:14.932453 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Resulting device map defaultdict(. at 0x73e7b813af20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53'): ({'sdb'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:05:14.932768 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Removing multipathed devices sdc, sdb {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:05:14.933072 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Flush multipath device 33000000087ed8df5 {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:05:14.971678 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:05:15.015164 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:05:15.035288 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:15.065954 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:05:15.067872 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:05:15.067872 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:05:15.082734 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:05:15.082734 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:05:15.096390 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:15.118231 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53, portal: 192.168.40.100,3260] Jun 03 01:05:15.118231 np0000002000 nova-compute[98288]: Logout of [sid: 2, target: iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53, portal: 192.168.40.100,3260] successful. Jun 03 01:05:15.118231 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:15.128940 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:15.138738 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:15.163357 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:15.164262 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:15.164423 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] VM Paused (Lifecycle Event) Jun 03 01:05:15.167532 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53, portal: 192.168.50.100,3260] Jun 03 01:05:15.167532 np0000002000 nova-compute[98288]: Logout of [sid: 1, target: iqn.2023-03.storpool.com:os--volume-fe7c96d1-2ba1-4c1f-b724-3a49de416d53, portal: 192.168.50.100,3260] successful. Jun 03 01:05:15.167532 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:15.176779 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Creating config drive at /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.config Jun 03 01:05:15.178428 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:15.178428 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:15.178428 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] <== disconnect_volume: return (274ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:15.178428 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:05:15.178925 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Deleting instance files /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03_del Jun 03 01:05:15.179907 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Deletion of /opt/stack/data/nova/instances/51db6d36-20a9-4490-9210-1469eae21d03_del complete Jun 03 01:05:15.186353 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_9c4x68d {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:15.223224 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_9c4x68d" returned: 0 in 0.037s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:15.311116 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json -f qcow2 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:15.353567 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d7c08325-d6d1-4210-aaee-9e88a6ecdf85 req-525786ec-075b-41a0-b25f-d00fa0774f07 service nova] Releasing lock "refresh_cache-697c41c0-3674-4c57-b793-7ab8a4abe82a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:15.382401 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json -f qcow2" returned: 0 in 0.071s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:15.383660 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json -f qcow2 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:15.434204 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Compute_service record updated for np0000002000:np0000002000 {{(pid=98288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 03 01:05:15.434488 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.948s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:15.435678 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.72 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:05:15.457054 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json -f qcow2" returned: 0 in 0.074s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:15.457733 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:15.460286 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:15.460666 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:15.526541 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.066s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:15.527005 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpygog_g8d/3a7bce5114d34e0a954389203045f3d3.delta 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:15.566480 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpygog_g8d/3a7bce5114d34e0a954389203045f3d3.delta 1073741824" returned: 0 in 0.039s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:15.567434 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Quiescing instance not available: QEMU guest agent is not enabled. Jun 03 01:05:15.668087 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:15.675393 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:15.687156 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:15.694280 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Took 1.70 seconds to destroy the instance on the hypervisor. Jun 03 01:05:15.694859 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:05:15.694965 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:05:15.695043 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:05:15.695425 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:15.712149 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:15.715934 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:15.771467 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:15.881978 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:15.885065 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:15.923421 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Received event network-vif-plugged-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:15.923841 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] Acquiring lock "f448afac-6687-4a4a-84ff-b4478c316986-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:15.924094 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] Lock "f448afac-6687-4a4a-84ff-b4478c316986-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:15.924269 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] Lock "f448afac-6687-4a4a-84ff-b4478c316986-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:15.924468 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Processing event network-vif-plugged-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:05:15.924652 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Received event network-vif-plugged-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:15.924830 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] Acquiring lock "f448afac-6687-4a4a-84ff-b4478c316986-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:15.924994 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] Lock "f448afac-6687-4a4a-84ff-b4478c316986-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:15.925129 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] Lock "f448afac-6687-4a4a-84ff-b4478c316986-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:15.925269 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] No waiting events found dispatching network-vif-plugged-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:15.925415 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Received unexpected event network-vif-plugged-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 for instance with vm_state building and task_state spawning. Jun 03 01:05:15.925589 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Received event network-vif-plugged-d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:15.925749 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] Acquiring lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:15.925906 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:15.926082 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:15.926233 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-36e36549-e7a5-4f45-9401-cc1efb6ca477 req-42761fa5-0bfa-447c-b964-996aedb104c8 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Processing event network-vif-plugged-d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:05:15.927144 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Instance event wait completed in 13 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:05:15.927561 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Instance event wait completed in 10 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:05:15.930154 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:05:15.933241 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:05:15.939758 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Instance spawned successfully. Jun 03 01:05:15.940186 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:05:15.947170 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Instance spawned successfully. Jun 03 01:05:15.947170 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:05:15.954029 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 03 01:05:15.957485 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 03 01:05:16.057277 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:16.097615 np0000002000 nova-compute[98288]: DEBUG nova.privsep.utils [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 03 01:05:16.097961 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpygog_g8d/3a7bce5114d34e0a954389203045f3d3.delta /opt/stack/data/nova/instances/snapshots/tmpygog_g8d/3a7bce5114d34e0a954389203045f3d3 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:16.178482 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:05:16.179678 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:16.179849 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f448afac-6687-4a4a-84ff-b4478c316986] VM Resumed (Lifecycle Event) Jun 03 01:05:16.199054 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b262761a-4aca-4e42-8341-0190ef1ee5a2 req-b7c92ad4-1fb3-483e-a9b5-eabeb8bd0dbf service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Received event network-vif-deleted-99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:16.200103 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-b262761a-4aca-4e42-8341-0190ef1ee5a2 req-b7c92ad4-1fb3-483e-a9b5-eabeb8bd0dbf service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Neutron deleted interface 99d6fecc-d026-4678-99ce-d8303121f361; detaching it from the instance and deleting it from the info cache Jun 03 01:05:16.202261 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b262761a-4aca-4e42-8341-0190ef1ee5a2 req-b7c92ad4-1fb3-483e-a9b5-eabeb8bd0dbf service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Detach interface failed, port_id=99d6fecc-d026-4678-99ce-d8303121f361, reason: Instance 51db6d36-20a9-4490-9210-1469eae21d03 could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:05:16.225616 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpygog_g8d/3a7bce5114d34e0a954389203045f3d3.delta /opt/stack/data/nova/instances/snapshots/tmpygog_g8d/3a7bce5114d34e0a954389203045f3d3" returned: 0 in 0.128s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:16.227284 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Snapshot extracted, beginning image upload Jun 03 01:05:16.455316 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:16.455572 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:16.455926 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:16.457385 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:16.457938 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:16.458116 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:16.458480 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:16.458739 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:16.459103 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:16.459653 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:16.460039 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:16.462304 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:16.480639 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:16.649180 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:16.654322 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-693d5345-82ae-4be1-9843-bdaf0918f45e req-04b48056-24ce-41ed-8ee8-3d84ffb84d5a service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Received event network-vif-unplugged-99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:16.654713 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-693d5345-82ae-4be1-9843-bdaf0918f45e req-04b48056-24ce-41ed-8ee8-3d84ffb84d5a service nova] Acquiring lock "51db6d36-20a9-4490-9210-1469eae21d03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:16.654927 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-693d5345-82ae-4be1-9843-bdaf0918f45e req-04b48056-24ce-41ed-8ee8-3d84ffb84d5a service nova] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:16.655041 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-693d5345-82ae-4be1-9843-bdaf0918f45e req-04b48056-24ce-41ed-8ee8-3d84ffb84d5a service nova] Lock "51db6d36-20a9-4490-9210-1469eae21d03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:16.655158 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-693d5345-82ae-4be1-9843-bdaf0918f45e req-04b48056-24ce-41ed-8ee8-3d84ffb84d5a service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] No waiting events found dispatching network-vif-unplugged-99d6fecc-d026-4678-99ce-d8303121f361 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:16.655690 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-693d5345-82ae-4be1-9843-bdaf0918f45e req-04b48056-24ce-41ed-8ee8-3d84ffb84d5a service nova] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Received event network-vif-unplugged-99d6fecc-d026-4678-99ce-d8303121f361 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:05:16.684413 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:16.688851 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:16.976505 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Took 18.35 seconds to spawn the instance on the hypervisor. Jun 03 01:05:16.976957 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:16.978033 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Took 20.87 seconds to spawn the instance on the hypervisor. Jun 03 01:05:16.978771 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:17.157927 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Took 1.46 seconds to deallocate network for instance. Jun 03 01:05:17.195837 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f448afac-6687-4a4a-84ff-b4478c316986] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:05:17.196074 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:17.196872 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] VM Resumed (Lifecycle Event) Jun 03 01:05:17.492843 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Took 28.63 seconds to build instance. Jun 03 01:05:17.505808 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Took 28.68 seconds to build instance. Jun 03 01:05:17.699200 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:17.704245 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:17.766972 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Took 0.61 seconds to detach 1 volumes for instance. Jun 03 01:05:17.811996 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:17.995734 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 30.143s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:18.007098 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 30.190s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:18.047092 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Received event network-vif-plugged-d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:18.048375 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Acquiring lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:18.048375 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:18.048375 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:18.048375 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] No waiting events found dispatching network-vif-plugged-d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:18.048565 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Received unexpected event network-vif-plugged-d20d1283-77a1-445e-ae92-60ef3ff039d5 for instance with vm_state active and task_state None. Jun 03 01:05:18.048565 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:18.048643 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] No event matching network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 in dict_keys([('network-vif-plugged', '6ca57b5b-fdc0-4f99-a76c-1bf9511024a1')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received unexpected event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 for instance with vm_state building and task_state spawning. Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received event network-vif-unplugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Acquiring lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] No event matching network-vif-unplugged-d485fb06-fb35-4f18-a724-b98151540d40 in dict_keys([('network-vif-plugged', 'd485fb06-fb35-4f18-a724-b98151540d40')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received unexpected event network-vif-unplugged-d485fb06-fb35-4f18-a724-b98151540d40 for instance with vm_state building and task_state spawning. Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:18.050904 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:18.051699 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Processing event network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:05:18.051699 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:18.051699 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:18.051699 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:18.051699 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:18.051699 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] No waiting events found dispatching network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:18.051699 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received unexpected event network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 for instance with vm_state building and task_state spawning. Jun 03 01:05:18.051699 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received event network-vif-plugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:18.051699 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Acquiring lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:18.051976 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:18.051976 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:18.051976 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Processing event network-vif-plugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:05:18.053659 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received event network-vif-plugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:18.053659 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:05:18.053659 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Acquiring lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:18.053659 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:18.053659 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:18.053659 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] No waiting events found dispatching network-vif-plugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:18.053659 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-eb3c8608-e496-42fd-8713-890a1b8591b3 req-4ef845d0-3ccc-4152-a293-7456471f133a service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received unexpected event network-vif-plugged-d485fb06-fb35-4f18-a724-b98151540d40 for instance with vm_state building and task_state spawning. Jun 03 01:05:18.053960 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:05:18.060966 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:05:18.061776 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:05:18.066978 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Instance spawned successfully. Jun 03 01:05:18.067128 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:05:18.070941 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Instance spawned successfully. Jun 03 01:05:18.071380 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:05:18.208233 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:18.208366 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] VM Started (Lifecycle Event) Jun 03 01:05:18.275391 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:18.275391 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:18.578868 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:18.578868 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:18.578868 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:18.578868 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:18.578868 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:18.578868 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:18.586725 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:18.586725 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:18.587492 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:18.587492 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:18.587492 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:18.587717 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:18.642134 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:18.712204 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:18.714308 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:18.963862 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:05:18.964091 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:05:19.086127 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Took 10.54 seconds to spawn the instance on the hypervisor. Jun 03 01:05:19.086127 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:19.105347 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Took 8.01 seconds to spawn the instance on the hypervisor. Jun 03 01:05:19.105585 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:19.217532 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:05:19.217760 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:19.217901 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] VM Paused (Lifecycle Event) Jun 03 01:05:19.462037 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-51fcdd42-8bf9-4887-909a-5a5af89131ab req-25c3abfe-a0ba-4b0f-ad54-d75dba687a59 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Received event network-changed-d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:19.462243 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-51fcdd42-8bf9-4887-909a-5a5af89131ab req-25c3abfe-a0ba-4b0f-ad54-d75dba687a59 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Refreshing instance network info cache due to event network-changed-d20d1283-77a1-445e-ae92-60ef3ff039d5. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:05:19.462430 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-51fcdd42-8bf9-4887-909a-5a5af89131ab req-25c3abfe-a0ba-4b0f-ad54-d75dba687a59 service nova] Acquiring lock "refresh_cache-2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:19.464060 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-51fcdd42-8bf9-4887-909a-5a5af89131ab req-25c3abfe-a0ba-4b0f-ad54-d75dba687a59 service nova] Acquired lock "refresh_cache-2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:19.465862 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-51fcdd42-8bf9-4887-909a-5a5af89131ab req-25c3abfe-a0ba-4b0f-ad54-d75dba687a59 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Refreshing network info cache for port d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:05:19.468541 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:05:19.599622 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Took 16.43 seconds to build instance. Jun 03 01:05:19.621191 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Took 14.87 seconds to build instance. Jun 03 01:05:19.664966 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Snapshot image upload complete Jun 03 01:05:19.665167 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-7f6164ae-7665-4af8-a3c5-8bd4c4752d4b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Took 6.05 seconds to snapshot the instance on the hypervisor. Jun 03 01:05:19.721968 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:19.724322 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:19.724470 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] VM Resumed (Lifecycle Event) Jun 03 01:05:19.911696 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:19.968327 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-51fcdd42-8bf9-4887-909a-5a5af89131ab req-25c3abfe-a0ba-4b0f-ad54-d75dba687a59 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:19.978168 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.703s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:20.063427 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Deleted allocations for instance 51db6d36-20a9-4490-9210-1469eae21d03 Jun 03 01:05:20.101988 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-3050236e-2774-49c2-87a8-64c7cafc8616 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.941s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:20.123066 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e890156c-ac41-44ea-8a1a-9964e91bc8bd tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.380s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:20.230020 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:20.231572 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:20.456924 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-51fcdd42-8bf9-4887-909a-5a5af89131ab req-25c3abfe-a0ba-4b0f-ad54-d75dba687a59 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:20.649702 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-51fcdd42-8bf9-4887-909a-5a5af89131ab req-25c3abfe-a0ba-4b0f-ad54-d75dba687a59 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Updated VIF entry in instance network info cache for port d20d1283-77a1-445e-ae92-60ef3ff039d5. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:05:20.650075 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-51fcdd42-8bf9-4887-909a-5a5af89131ab req-25c3abfe-a0ba-4b0f-ad54-d75dba687a59 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Updating instance_info_cache with network_info: [{"id": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "address": "fa:16:3e:7f:c1:07", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d1283-77", "ovs_interfaceid": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:20.678140 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Rescuing Jun 03 01:05:20.679645 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "refresh_cache-2bdcee06-76d6-431e-bef1-84b1acf1ccca" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:20.680916 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquired lock "refresh_cache-2bdcee06-76d6-431e-bef1-84b1acf1ccca" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:20.680916 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:05:20.733838 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] During sync_power_state the instance has a pending task (rescuing). Skip. Jun 03 01:05:20.734145 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:20.734322 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] VM Resumed (Lifecycle Event) Jun 03 01:05:21.073394 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7716ca21-5d75-4f73-ad4d-1afdc89b693c tempest-DeleteServersTestJSON-1608594473 tempest-DeleteServersTestJSON-1608594473-project-member] Lock "51db6d36-20a9-4490-9210-1469eae21d03" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.600s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:21.152534 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-51fcdd42-8bf9-4887-909a-5a5af89131ab req-25c3abfe-a0ba-4b0f-ad54-d75dba687a59 service nova] Releasing lock "refresh_cache-2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:21.184352 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:21.238345 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:21.242257 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:21.570181 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00046059200008130574 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:21.570666 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:21.571178 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.802946547999909 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:21.571397 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.80271569599995 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:21.572729 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:21.572910 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] VM Stopped (Lifecycle Event) Jun 03 01:05:21.617643 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:21.807427 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Updating instance_info_cache with network_info: [{"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:22.076171 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 77723037-3c0b-4a83-8cf1-6fc0fe05865d] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:22.237850 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:22.238312 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "5fa25fea-9624-4611-8579-d6891f822679" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:22.309840 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Releasing lock "refresh_cache-2bdcee06-76d6-431e-bef1-84b1acf1ccca" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:22.740367 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:05:22.813122 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:23.330916 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:23.331383 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:23.333825 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:05:23.333954 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Claim successful on node np0000002000 Jun 03 01:05:23.972021 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:23.974404 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:23.995516 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:24.215319 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5cc08141-605b-41ac-bca8-1e562f0f605a req-5906a872-a5b5-4ba9-a51d-437c2e468952 service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received event network-vif-unplugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:24.215654 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5cc08141-605b-41ac-bca8-1e562f0f605a req-5906a872-a5b5-4ba9-a51d-437c2e468952 service nova] Acquiring lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:24.215753 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5cc08141-605b-41ac-bca8-1e562f0f605a req-5906a872-a5b5-4ba9-a51d-437c2e468952 service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:24.215868 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5cc08141-605b-41ac-bca8-1e562f0f605a req-5906a872-a5b5-4ba9-a51d-437c2e468952 service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:24.215983 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5cc08141-605b-41ac-bca8-1e562f0f605a req-5906a872-a5b5-4ba9-a51d-437c2e468952 service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] No waiting events found dispatching network-vif-unplugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:24.216088 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-5cc08141-605b-41ac-bca8-1e562f0f605a req-5906a872-a5b5-4ba9-a51d-437c2e468952 service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received unexpected event network-vif-unplugged-d485fb06-fb35-4f18-a724-b98151540d40 for instance with vm_state active and task_state rescuing. Jun 03 01:05:24.255354 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:24.264754 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:24.269464 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:24.278025 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:24.288106 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999745613999949 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:24.294150 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Instance destroyed successfully. Jun 03 01:05:24.295300 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'numa_topology' on Instance uuid 2bdcee06-76d6-431e-bef1-84b1acf1ccca {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:24.796096 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:24.805370 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Attempting rescue Jun 03 01:05:24.806116 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} Jun 03 01:05:24.816191 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Instance directory exists: not creating {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} Jun 03 01:05:24.816455 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Creating image(s) Jun 03 01:05:24.817140 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:24.817335 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "/opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:24.817870 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "/opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:24.818100 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2bdcee06-76d6-431e-bef1-84b1acf1ccca {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:24.913204 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:24.972342 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:05:24.972556 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:05:25.323858 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<2bdcee06-76d6-431e-bef1-84b1acf1ccca> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:25.323858 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:25.326135 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:25.327180 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:25.327463 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:25.328279 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:25.330612 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:25.330987 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:25.428822 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.097s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:25.429419 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:25.477078 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:05:25.487606 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue" returned: 0 in 0.058s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:25.487990 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.160s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:25.488222 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'migration_context' on Instance uuid 2bdcee06-76d6-431e-bef1-84b1acf1ccca {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:25.990729 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.660s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:25.992842 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:05:25.996024 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<2bdcee06-76d6-431e-bef1-84b1acf1ccca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:25.997557 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:05:25.997557 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Start _get_guest_xml network_info=[{"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "vif_mac": "fa:16:3e:72:87:e7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue={'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:05:25.997557 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'resources' on Instance uuid 2bdcee06-76d6-431e-bef1-84b1acf1ccca {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:26.323359 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-14692acf-5f02-4b34-9dc6-aca6def7399c req-2fc94e04-d007-4c7e-bc7e-41d97ad488a0 service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received event network-vif-unplugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:26.323600 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-14692acf-5f02-4b34-9dc6-aca6def7399c req-2fc94e04-d007-4c7e-bc7e-41d97ad488a0 service nova] Acquiring lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:26.323691 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-14692acf-5f02-4b34-9dc6-aca6def7399c req-2fc94e04-d007-4c7e-bc7e-41d97ad488a0 service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:26.323807 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-14692acf-5f02-4b34-9dc6-aca6def7399c req-2fc94e04-d007-4c7e-bc7e-41d97ad488a0 service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:26.323919 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-14692acf-5f02-4b34-9dc6-aca6def7399c req-2fc94e04-d007-4c7e-bc7e-41d97ad488a0 service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] No waiting events found dispatching network-vif-unplugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:26.324051 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-14692acf-5f02-4b34-9dc6-aca6def7399c req-2fc94e04-d007-4c7e-bc7e-41d97ad488a0 service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received unexpected event network-vif-unplugged-d485fb06-fb35-4f18-a724-b98151540d40 for instance with vm_state active and task_state rescuing. Jun 03 01:05:26.503343 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:05:26.503695 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:05:26.504361 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<2bdcee06-76d6-431e-bef1-84b1acf1ccca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:26.504687 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:26.505140 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:26.510531 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:05:26.513243 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-933697352', uuid='2bdcee06-76d6-431e-bef1-84b1acf1ccca'), owner=OwnerMeta(userid='a97328826b194121a85a35b41129c1a9', username='tempest-ServerRescueNegativeTestJSON-335039479-project-member', projectid='8d71b7749b9b414ea4fb3ad943aebf49', projectname='tempest-ServerRescueNegativeTestJSON-335039479'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "vif_mac": "fa:16:3e:72:87:e7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448726.5117507) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:05:26.514127 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:05:26.514604 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:05:26.517528 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:05:26.517528 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:05:26.519630 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:05:26.519630 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:05:26.519630 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:05:26.519630 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:05:26.519630 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:05:26.519630 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:05:26.519877 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:05:26.519877 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:05:26.520318 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:05:26.520318 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:05:26.520318 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:05:26.520949 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:05:26.521254 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2bdcee06-76d6-431e-bef1-84b1acf1ccca {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:26.581076 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:26.631515 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a5f52b75bd44cd880fcd26870d24190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b5c165c8b142b6af1c20eeac918eb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:05:27.006276 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:05:27.023069 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<2bdcee06-76d6-431e-bef1-84b1acf1ccca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:27.044019 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-933697352',display_name='tempest-ServerRescueNegativeTestJSON-server-933697352',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverrescuenegativetestjson-server-933697352',id=10,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-03T01:05:19Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8d71b7749b9b414ea4fb3ad943aebf49',ramdisk_id='',reservation_id='r-4yumn2hi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-335039479',owner_user_name='tempest-ServerRescueNegativeTestJSON-335039479-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:05:19Z,user_data=None,user_id='a97328826b194121a85a35b41129c1a9',uuid=2bdcee06-76d6-431e-bef1-84b1acf1ccca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "vif_mac": "fa:16:3e:72:87:e7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:05:27.044661 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converting VIF {"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "vif_mac": "fa:16:3e:72:87:e7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:05:27.045769 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:87:e7,bridge_name='br-int',has_traffic_filtering=True,id=d485fb06-fb35-4f18-a724-b98151540d40,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd485fb06-fb') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:05:27.046592 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bdcee06-76d6-431e-bef1-84b1acf1ccca {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:27.514542 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:05:27.550421 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<2bdcee06-76d6-431e-bef1-84b1acf1ccca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] End _get_guest_xml xml= Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 2bdcee06-76d6-431e-bef1-84b1acf1ccca Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: instance-0000000a Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 196608 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-server-933697352 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 2026-06-03 01:05:26 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 192 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: True Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: bare Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: ide Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: virtio Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: pc Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: virtio Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: virtio Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: virtio Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-335039479-project-member Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-335039479 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 2bdcee06-76d6-431e-bef1-84b1acf1ccca Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 2bdcee06-76d6-431e-bef1-84b1acf1ccca Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: hvm Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 128 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: Jun 03 01:05:27.554697 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:05:27.564320 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Instance destroyed successfully. Jun 03 01:05:27.596620 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Successfully created port: c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:05:27.815118 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:28.021541 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Booting with blank volume at /dev/vda Jun 03 01:05:28.557748 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:28.700517 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Successfully updated port: c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:05:28.753892 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2d700f05-7912-4f75-8e28-946cb244fc4e req-3983cdaa-9674-4dd4-9a6b-9e6fa9e8eaa1 service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-changed-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:28.755687 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2d700f05-7912-4f75-8e28-946cb244fc4e req-3983cdaa-9674-4dd4-9a6b-9e6fa9e8eaa1 service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Refreshing instance network info cache due to event network-changed-c9849bf1-2517-4a9c-8033-605596ac9dfd. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:05:28.755819 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2d700f05-7912-4f75-8e28-946cb244fc4e req-3983cdaa-9674-4dd4-9a6b-9e6fa9e8eaa1 service nova] Acquiring lock "refresh_cache-5fa25fea-9624-4611-8579-d6891f822679" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:28.755914 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2d700f05-7912-4f75-8e28-946cb244fc4e req-3983cdaa-9674-4dd4-9a6b-9e6fa9e8eaa1 service nova] Acquired lock "refresh_cache-5fa25fea-9624-4611-8579-d6891f822679" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:28.756025 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-2d700f05-7912-4f75-8e28-946cb244fc4e req-3983cdaa-9674-4dd4-9a6b-9e6fa9e8eaa1 service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Refreshing network info cache for port c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:05:29.086720 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:29.086720 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:29.088574 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:29.088574 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No VIF found with MAC fa:16:3e:72:87:e7, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:05:29.088574 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Using config drive Jun 03 01:05:29.203602 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "refresh_cache-5fa25fea-9624-4611-8579-d6891f822679" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:29.258722 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-2d700f05-7912-4f75-8e28-946cb244fc4e req-3983cdaa-9674-4dd4-9a6b-9e6fa9e8eaa1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:29.326520 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-2d700f05-7912-4f75-8e28-946cb244fc4e req-3983cdaa-9674-4dd4-9a6b-9e6fa9e8eaa1 service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:05:29.375463 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000427471000193691 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:29.375463 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:29.375463 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:29.375650 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=9.912312673000088 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:29.375650 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=9.912197283000069 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:29.375811 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] VM Stopped (Lifecycle Event) Jun 03 01:05:29.480048 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-2d700f05-7912-4f75-8e28-946cb244fc4e req-3983cdaa-9674-4dd4-9a6b-9e6fa9e8eaa1 service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:29.590133 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'ec2_ids' on Instance uuid 2bdcee06-76d6-431e-bef1-84b1acf1ccca {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:29.879891 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 51db6d36-20a9-4490-9210-1469eae21d03] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:29.914602 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:29.982782 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2d700f05-7912-4f75-8e28-946cb244fc4e req-3983cdaa-9674-4dd4-9a6b-9e6fa9e8eaa1 service nova] Releasing lock "refresh_cache-5fa25fea-9624-4611-8579-d6891f822679" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:29.983164 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquired lock "refresh_cache-5fa25fea-9624-4611-8579-d6891f822679" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:29.983413 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:05:30.095285 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<2bdcee06-76d6-431e-bef1-84b1acf1ccca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:30.095285 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'keypairs' on Instance uuid 2bdcee06-76d6-431e-bef1-84b1acf1ccca {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:30.579922 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:30.597701 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<2bdcee06-76d6-431e-bef1-84b1acf1ccca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:30.600760 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:30.608190 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:05:30.787315 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Creating config drive at /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.config.rescue Jun 03 01:05:30.793511 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzdnb5yce {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:30.843205 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzdnb5yce" returned: 0 in 0.049s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:30.897052 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:31.347802 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:31.374330 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:31.442679 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Updating instance_info_cache with network_info: [{"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:31.473912 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:31.560493 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:31.577138 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:31.588183 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:05:31.613927 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:31.638335 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:05:31.638576 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:05:31.646432 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:05:31.648171 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feee:1536', 'fe80::fc16:3eff:feb8:822', 'fe80::3c26:53ff:feb3:4c94', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::fc16:3eff:fed9:ee44', 'fe80::10fa:b6ff:fe2c:a1ba', 'fe80::fc16:3eff:fed9:fdf9', 'fe80::489c:41ff:febd:1e4c', 'fe80::fc16:3eff:fe5c:d4cc', 'fe80::34c3:b7ff:fe30:cb04', 'fe80::fc16:3eff:fe7f:c107', 'fe80::fc16:3eff:fe29:1d7b', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7'] Jun 03 01:05:31.648512 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:05:31.648647 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:05:31.648966 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] <== get_connector_properties: return (73ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:31.649258 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Updating existing volume attachment record: 8315294d-b7ca-404d-bd23-3ef76d7735af {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:05:31.947374 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Releasing lock "refresh_cache-5fa25fea-9624-4611-8579-d6891f822679" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:31.947828 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Instance network_info: |[{"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:05:32.301012 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Removed pending STOPPED event for 2bdcee06-76d6-431e-bef1-84b1acf1ccca due to new event Resumed> {{(pid=98288) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 03 01:05:32.301012 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:32.301012 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] VM Resumed (Lifecycle Event) Jun 03 01:05:32.305285 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-f7bec090-183e-4e73-87d1-fdb06c306d82 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:32.625761 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:32.803525 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:32.806026 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:32.819257 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:33.308034 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:33.308259 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] VM Started (Lifecycle Event) Jun 03 01:05:33.808491 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:05:33.810504 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:05:33.810504 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Creating image(s) Jun 03 01:05:33.810504 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Did not create local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} Jun 03 01:05:33.810682 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Ensure instance console log exists: /opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:05:33.811487 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:33.811487 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:33.811487 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:33.812566 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Start _get_guest_xml network_info=[{"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '8315294d-b7ca-404d-bd23-3ef76d7735af', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5fa25fea-9624-4611-8579-d6891f822679', 'attached_at': '', 'detached_at': '', 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'serial': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:05:33.815068 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:05:33.815068 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-598665403', uuid='5fa25fea-9624-4611-8579-d6891f822679'), owner=OwnerMeta(userid='6a5f52b75bd44cd880fcd26870d24190', username='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member', projectid='e3b5c165c8b142b6af1c20eeac918eb0', projectname='tempest-ServerBootFromVolumeStableRescueTest-1020364370'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448733.8145661) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:05:33.816322 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:33.817037 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:05:33.817587 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:05:33.820467 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:05:33.820467 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:05:33.820467 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:05:33.820467 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:05:33.820467 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:05:33.821688 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:33.826463 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:05:33.826463 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:05:33.826463 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:05:33.826463 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:05:33.826463 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:05:33.826463 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:05:33.826463 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:05:33.826463 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:05:33.826463 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:05:33.841660 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:05:33.842768 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:33.843083 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:33.843778 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:33.844139 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:05:33.859647 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:33.860544 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:33.860951 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:33.861323 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:05:33.861537 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:33.861807 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:05:33.874971 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:05:33.874971 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:33.881090 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:05:33.881090 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:33.889066 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef] added Jun 03 01:05:33.889066 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:05:33.889066 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:33.889066 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:33.889066 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:33.889066 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:33.889066 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:33.889517 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:05:33.889881 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:05:33.890153 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:05:33.892618 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef] added Jun 03 01:05:33.892618 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:05:33.892618 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:33.892618 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:33.892618 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:33.892618 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:33.892618 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:33.892836 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:05:33.892911 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:05:33.893028 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:05:34.809246 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Rescuing Jun 03 01:05:34.809246 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "refresh_cache-cbb3ba9a-f26f-40c4-ac5b-00470740fd96" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:34.809246 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquired lock "refresh_cache-cbb3ba9a-f26f-40c4-ac5b-00470740fd96" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:34.809246 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:05:34.890851 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:05:34.895301 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:34.905667 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:34.914940 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:34.921269 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:34.921269 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:34.925821 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:34.933654 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 03 01:05:34.933654 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:34.933654 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 03 01:05:34.933654 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:34.933654 np0000002000 nova-compute[98288]: WARNING os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 03 01:05:34.933654 np0000002000 nova-compute[98288]: Jun 03 01:05:34.939892 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 03 01:05:34.939892 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:34.940049 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 03 01:05:34.940049 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:34.940160 np0000002000 nova-compute[98288]: WARNING os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 03 01:05:34.940160 np0000002000 nova-compute[98288]: Jun 03 01:05:35.314465 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:35.699724 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:35.846758 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Updating instance_info_cache with network_info: [{"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:35.965546 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef, portal: 192.168.40.100,3260] Jun 03 01:05:35.965546 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef, portal: 192.168.40.100,3260] successful. Jun 03 01:05:35.965546 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:35.966128 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef, portal: 192.168.50.100,3260] Jun 03 01:05:35.966128 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef, portal: 192.168.50.100,3260] successful. Jun 03 01:05:35.966128 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:35.979988 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:35.986644 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:35.993987 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:35.993987 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:35.993987 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:35.994243 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:35.994243 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:35.994243 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:35.994526 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.134s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:35.994664 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:35.995313 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:35.995477 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:36.000994 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:36.000994 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:36.000994 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:36.000994 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:36.000994 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:36.000994 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:36.001622 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.141s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:36.002803 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:36.002803 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:36.002803 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:36.009633 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:36.009633 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:36.022312 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:36.022312 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:36.349664 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Releasing lock "refresh_cache-cbb3ba9a-f26f-40c4-ac5b-00470740fd96" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:36.590284 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:36.696140 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d31653f7-9715-4522-b4af-2f29636055fa req-1a559cae-f343-4684-9ea5-27dd0611f0c5 service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received event network-vif-plugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:36.696691 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d31653f7-9715-4522-b4af-2f29636055fa req-1a559cae-f343-4684-9ea5-27dd0611f0c5 service nova] Acquiring lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:36.696907 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d31653f7-9715-4522-b4af-2f29636055fa req-1a559cae-f343-4684-9ea5-27dd0611f0c5 service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:36.697081 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d31653f7-9715-4522-b4af-2f29636055fa req-1a559cae-f343-4684-9ea5-27dd0611f0c5 service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:36.697296 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d31653f7-9715-4522-b4af-2f29636055fa req-1a559cae-f343-4684-9ea5-27dd0611f0c5 service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] No waiting events found dispatching network-vif-plugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:36.697424 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-d31653f7-9715-4522-b4af-2f29636055fa req-1a559cae-f343-4684-9ea5-27dd0611f0c5 service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received unexpected event network-vif-plugged-d485fb06-fb35-4f18-a724-b98151540d40 for instance with vm_state rescued and task_state None. Jun 03 01:05:36.862518 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:05:37.821786 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:37.876937 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Found WWN 330000000681717e1 for multipath device dm-0 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:05:37.877527 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.033s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:37.877527 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] <== connect_volume: return (4034ms) {'type': 'block', 'scsi_wwn': '330000000681717e1', 'path': '/dev/dm-0', 'multipath_id': '330000000681717e1'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:37.877610 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000681717e1', 'path': '/dev/dm-0', 'multipath_id': '330000000681717e1'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:05:37.969179 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:37.976591 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:37.999808 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:38.158838 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:38.168847 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:38.248873 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:38.257366 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:38.282921 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999658707000208 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:38.284233 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Instance destroyed successfully. Jun 03 01:05:38.284605 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'numa_topology' on Instance uuid cbb3ba9a-f26f-40c4-ac5b-00470740fd96 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:38.383538 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-598665403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-598665403',id=11,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-sdp2alb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:05:28Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=5fa25fea-9624-4611-8579-d6891f822679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:05:38.384152 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:05:38.384424 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:47:da,bridge_name='br-int',has_traffic_filtering=True,id=c9849bf1-2517-4a9c-8033-605596ac9dfd,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9849bf1-25') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:05:38.385044 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fa25fea-9624-4611-8579-d6891f822679 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:38.764282 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-1d9e4f7e-5bc2-4961-9af5-3ed4c115c2bd req-ffe4087b-abf8-4db9-91a6-cbf7f05e3ee2 service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received event network-vif-plugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:38.764429 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-1d9e4f7e-5bc2-4961-9af5-3ed4c115c2bd req-ffe4087b-abf8-4db9-91a6-cbf7f05e3ee2 service nova] Acquiring lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:38.764652 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-1d9e4f7e-5bc2-4961-9af5-3ed4c115c2bd req-ffe4087b-abf8-4db9-91a6-cbf7f05e3ee2 service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:38.764805 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-1d9e4f7e-5bc2-4961-9af5-3ed4c115c2bd req-ffe4087b-abf8-4db9-91a6-cbf7f05e3ee2 service nova] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:38.765293 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-1d9e4f7e-5bc2-4961-9af5-3ed4c115c2bd req-ffe4087b-abf8-4db9-91a6-cbf7f05e3ee2 service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] No waiting events found dispatching network-vif-plugged-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:38.765412 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-1d9e4f7e-5bc2-4961-9af5-3ed4c115c2bd req-ffe4087b-abf8-4db9-91a6-cbf7f05e3ee2 service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received unexpected event network-vif-plugged-d485fb06-fb35-4f18-a724-b98151540d40 for instance with vm_state rescued and task_state None. Jun 03 01:05:38.787690 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Attempting rescue Jun 03 01:05:38.788145 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} Jun 03 01:05:38.790360 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Instance directory exists: not creating {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} Jun 03 01:05:38.790459 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Creating image(s) Jun 03 01:05:38.790912 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:38.791050 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "/opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:38.791479 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "/opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:38.791631 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'trusted_certs' on Instance uuid cbb3ba9a-f26f-40c4-ac5b-00470740fd96 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] End _get_guest_xml xml= Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 5fa25fea-9624-4611-8579-d6891f822679 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: instance-0000000b Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 196608 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-server-598665403 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 2026-06-03 01:05:33 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 192 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: True Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: bare Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: virtio Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-1020364370 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 5fa25fea-9624-4611-8579-d6891f822679 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 5fa25fea-9624-4611-8579-d6891f822679 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: hvm Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 128 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: 0f48e8a0-3cad-4972-9467-17b0c1c7bdef Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: Jun 03 01:05:38.890465 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:05:38.892718 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Preparing to wait for external event network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:05:38.892718 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:38.892718 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:38.892718 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:38.892718 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-598665403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-598665403',id=11,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-sdp2alb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:05:28Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=5fa25fea-9624-4611-8579-d6891f822679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:05:38.892933 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:05:38.892933 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:47:da,bridge_name='br-int',has_traffic_filtering=True,id=c9849bf1-2517-4a9c-8033-605596ac9dfd,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9849bf1-25') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:05:38.892933 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:47:da,bridge_name='br-int',has_traffic_filtering=True,id=c9849bf1-2517-4a9c-8033-605596ac9dfd,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9849bf1-25') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:05:38.892933 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:38.893130 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:38.893323 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:05:38.893905 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:38.894070 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f37b082f-1436-5c36-a343-168a444d3d07', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:38.895465 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:05:38.899797 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:38.901660 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:38.901794 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9849bf1-25, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:38.902055 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9849bf1-25, col_values=(('qos', UUID('39a2448a-3115-4984-8e51-f6fab9de12b8')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:38.902210 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9849bf1-25, col_values=(('external_ids', {'iface-id': 'c9849bf1-2517-4a9c-8033-605596ac9dfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:47:da', 'vm-uuid': '5fa25fea-9624-4611-8579-d6891f822679'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:05:38.903994 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:05:38.911217 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:38.912357 np0000002000 nova-compute[98288]: INFO os_vif [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:47:da,bridge_name='br-int',has_traffic_filtering=True,id=c9849bf1-2517-4a9c-8033-605596ac9dfd,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9849bf1-25') Jun 03 01:05:39.288992 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0009075309999388992 future=) was cancelled during its delay period, skipping {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:39.288992 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:39.288992 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=13.993395707000218 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:39.288992 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=13.993318496000029 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:39.293128 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:39.293816 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:39.299597 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:39.300367 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:39.300712 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:39.301005 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:39.304636 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:39.304960 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:39.372799 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.067s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:39.373864 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.rescue {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:39.407184 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.rescue" returned: 0 in 0.033s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:39.407731 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.107s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:39.408096 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'migration_context' on Instance uuid cbb3ba9a-f26f-40c4-ac5b-00470740fd96 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:39.477010 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:39.894761 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Acquiring lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:39.895196 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:39.911013 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:39.911640 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:05:39.912340 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Start _get_guest_xml network_info=[{"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "vif_mac": "fa:16:3e:29:1d:7b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue={'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:05:39.912571 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'resources' on Instance uuid cbb3ba9a-f26f-40c4-ac5b-00470740fd96 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:40.401387 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lazy-loading 'flavor' on Instance uuid 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:40.417892 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:40.418940 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:05:40.420122 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-912542477', uuid='cbb3ba9a-f26f-40c4-ac5b-00470740fd96'), owner=OwnerMeta(userid='a97328826b194121a85a35b41129c1a9', username='tempest-ServerRescueNegativeTestJSON-335039479-project-member', projectid='8d71b7749b9b414ea4fb3ad943aebf49', projectname='tempest-ServerRescueNegativeTestJSON-335039479'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "vif_mac": "fa:16:3e:29:1d:7b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448740.4197812) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:05:40.421895 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:05:40.421895 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:05:40.426480 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:05:40.426875 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'vcpu_model' on Instance uuid cbb3ba9a-f26f-40c4-ac5b-00470740fd96 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:40.433332 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:40.433477 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:40.433535 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No VIF found with MAC fa:16:3e:e5:47:da, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:05:40.433932 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Using config drive Jun 03 01:05:40.930977 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:40.941429 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:40.948367 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-912542477',display_name='tempest-ServerRescueNegativeTestJSON-server-912542477',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverrescuenegativetestjson-server-912542477',id=9,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-03T01:05:19Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8d71b7749b9b414ea4fb3ad943aebf49',ramdisk_id='',reservation_id='r-8e5i10vc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-335039479',owner_user_name='tempest-ServerRescueNegativeTestJSON-335039479-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:05:19Z,user_data=None,user_id='a97328826b194121a85a35b41129c1a9',uuid=cbb3ba9a-f26f-40c4-ac5b-00470740fd96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "vif_mac": "fa:16:3e:29:1d:7b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:05:40.948596 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converting VIF {"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "vif_mac": "fa:16:3e:29:1d:7b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:05:40.949325 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:1d:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ca57b5b-fdc0-4f99-a76c-1bf9511024a1,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca57b5b-fd') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:05:40.949975 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'pci_devices' on Instance uuid cbb3ba9a-f26f-40c4-ac5b-00470740fd96 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:41.088391 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Creating config drive at /opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.config Jun 03 01:05:41.091223 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpq1lic2fs {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:41.122354 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpq1lic2fs" returned: 0 in 0.031s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:41.409462 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.514s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:41.454593 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] End _get_guest_xml xml= Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: cbb3ba9a-f26f-40c4-ac5b-00470740fd96 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: instance-00000009 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: 196608 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-server-912542477 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: 2026-06-03 01:05:40 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: 192 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: True Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: bare Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: 0 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: ide Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: virtio Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: pc Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: virtio Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: virtio Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: virtio Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-335039479-project-member Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-335039479 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: cbb3ba9a-f26f-40c4-ac5b-00470740fd96 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: cbb3ba9a-f26f-40c4-ac5b-00470740fd96 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: hvm Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: 128 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: 1 Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: Jun 03 01:05:41.455757 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:05:41.464184 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Instance destroyed successfully. Jun 03 01:05:41.543993 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:41.574287 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:41.680483 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:41.705785 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:41.712255 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:41.786742 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:41.787162 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:42.293231 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lazy-loading 'flavor' on Instance uuid 1225d1ad-70c5-43e1-b8f0-927efb3ef6be {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:42.374703 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:42.375894 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] VM Started (Lifecycle Event) Jun 03 01:05:42.823799 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:42.878058 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Acquiring lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:42.878058 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:42.878058 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Attaching volume 38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 to /dev/vdb Jun 03 01:05:42.880459 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:42.883323 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:42.884762 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] VM Paused (Lifecycle Event) Jun 03 01:05:42.974826 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:42.985214 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:42.986077 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:42.986330 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:42.986620 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No VIF found with MAC fa:16:3e:29:1d:7b, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:05:42.987887 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Using config drive Jun 03 01:05:42.989839 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:05:43.012022 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:43.033701 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:05:43.034064 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:05:43.041026 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:05:43.042395 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feee:1536', 'fe80::fc16:3eff:feb8:822', 'fe80::3c26:53ff:feb3:4c94', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::fc16:3eff:fed9:ee44', 'fe80::10fa:b6ff:fe2c:a1ba', 'fe80::fc16:3eff:fed9:fdf9', 'fe80::489c:41ff:febd:1e4c', 'fe80::fc16:3eff:fe5c:d4cc', 'fe80::34c3:b7ff:fe30:cb04', 'fe80::fc16:3eff:fe7f:c107', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fee5:47da'] Jun 03 01:05:43.042624 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:05:43.042837 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:05:43.043106 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] <== get_connector_properties: return (68ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:43.043364 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Updating existing volume attachment record: 75933f76-f7b8-4f28-9d40-8019d27125d8 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:05:43.304691 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.517s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:43.392695 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:43.394197 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:43.491680 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'ec2_ids' on Instance uuid cbb3ba9a-f26f-40c4-ac5b-00470740fd96 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:43.603142 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:05:43.603142 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:43.603291 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:43.614102 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.011s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:43.614393 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:05:43.630241 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:43.631179 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:43.632095 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:43.632231 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:05:43.632693 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:43.632925 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:05:43.645044 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:05:43.645044 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:43.645357 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:05:43.645357 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:43.657675 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8] added Jun 03 01:05:43.657675 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:05:43.657675 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:43.657675 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:43.657675 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:43.657675 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:43.657675 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:43.658014 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:05:43.658096 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:05:43.658644 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8] added Jun 03 01:05:43.658644 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:05:43.658644 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:43.658644 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:43.658644 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:43.658644 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:43.658644 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:43.658865 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:05:43.658926 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:05:43.659154 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:05:43.659282 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:05:43.897081 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:05:43.904887 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:43.998021 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:43.998021 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'keypairs' on Instance uuid cbb3ba9a-f26f-40c4-ac5b-00470740fd96 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:44.499009 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:44.501487 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:44.588788 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5a1e332d-e7ca-4d3b-b733-548f4dbc6d1c req-81f1a089-f9d9-4cf8-988d-77bbcba36abd service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:44.589419 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5a1e332d-e7ca-4d3b-b733-548f4dbc6d1c req-81f1a089-f9d9-4cf8-988d-77bbcba36abd service nova] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:44.590535 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5a1e332d-e7ca-4d3b-b733-548f4dbc6d1c req-81f1a089-f9d9-4cf8-988d-77bbcba36abd service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:44.590705 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5a1e332d-e7ca-4d3b-b733-548f4dbc6d1c req-81f1a089-f9d9-4cf8-988d-77bbcba36abd service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:44.590868 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5a1e332d-e7ca-4d3b-b733-548f4dbc6d1c req-81f1a089-f9d9-4cf8-988d-77bbcba36abd service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] No waiting events found dispatching network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:44.591051 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-5a1e332d-e7ca-4d3b-b733-548f4dbc6d1c req-81f1a089-f9d9-4cf8-988d-77bbcba36abd service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received unexpected event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 for instance with vm_state active and task_state rescuing. Jun 03 01:05:44.633868 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Creating config drive at /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.config.rescue Jun 03 01:05:44.637920 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpta3ccxnf {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:44.660393 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:05:44.661402 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:44.674852 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:44.678044 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:44.687966 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpta3ccxnf" returned: 0 in 0.049s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:44.690685 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:44.698964 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:44.707569 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.707569 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.707569 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:44.707569 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.707569 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.707569 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:44.714670 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.714670 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.714670 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:44.714670 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.714670 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.714670 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:44.723172 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:44.723172 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:44.723172 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Attaching volume 0782cb8d-527b-47ac-898d-a53b667d4af1 to /dev/vdb Jun 03 01:05:44.749511 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8, portal: 192.168.50.100,3260] Jun 03 01:05:44.749511 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8, portal: 192.168.50.100,3260] successful. Jun 03 01:05:44.749511 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:44.761741 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:44.767021 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8, portal: 192.168.40.100,3260] Jun 03 01:05:44.767021 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8, portal: 192.168.40.100,3260] successful. Jun 03 01:05:44.767021 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:44.770716 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:44.777045 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.777045 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.777045 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:44.777045 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:44.777045 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:44.777987 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.777987 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.777987 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:44.777987 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:44.777987 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:44.777987 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:44.777987 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:44.778453 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] HCTL ('9', '-', '-', 0) found on session 7 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:44.778585 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Scanning host 9 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:44.779181 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:44.793218 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:05:44.803517 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.803517 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.803517 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:44.803517 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:44.803517 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:44.803832 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.803832 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:44.803832 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:44.803832 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:44.803832 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:44.804799 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:44.805194 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:44.805721 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Searching for a device in session 7 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:44.806576 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] HCTL ('10', '-', '-', 0) found on session 8 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:44.806778 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:44.807287 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Scanning host 10 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:44.822823 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:44.836054 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Searching for a device in session 8 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:44.836487 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:44.849500 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:05:44.850102 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:05:44.865134 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:05:44.865757 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feee:1536', 'fe80::fc16:3eff:feb8:822', 'fe80::3c26:53ff:feb3:4c94', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::fc16:3eff:fed9:ee44', 'fe80::10fa:b6ff:fe2c:a1ba', 'fe80::fc16:3eff:fed9:fdf9', 'fe80::489c:41ff:febd:1e4c', 'fe80::fc16:3eff:fe5c:d4cc', 'fe80::34c3:b7ff:fe30:cb04', 'fe80::fc16:3eff:fe7f:c107', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fee5:47da'] Jun 03 01:05:44.865884 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:05:44.866010 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:05:44.866218 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:44.866431 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updating existing volume attachment record: 6bb12158-9ae5-4724-81fb-fe1f29a61e15 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:05:45.190738 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:45.223624 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:45.312398 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:45.389201 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:45.429221 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:05:45.429574 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:45.429754 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:45.500101 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7039d474-8a64-426e-9bee-f11c816929fc req-ac890e64-2dd8-4a9e-902f-87468cc2c32a service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:45.500496 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7039d474-8a64-426e-9bee-f11c816929fc req-ac890e64-2dd8-4a9e-902f-87468cc2c32a service nova] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:45.500496 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7039d474-8a64-426e-9bee-f11c816929fc req-ac890e64-2dd8-4a9e-902f-87468cc2c32a service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:45.500598 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7039d474-8a64-426e-9bee-f11c816929fc req-ac890e64-2dd8-4a9e-902f-87468cc2c32a service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:45.500714 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7039d474-8a64-426e-9bee-f11c816929fc req-ac890e64-2dd8-4a9e-902f-87468cc2c32a service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Processing event network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:05:45.501837 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:05:45.505123 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:45.507185 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:05:45.510712 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] VM Resumed (Lifecycle Event) Jun 03 01:05:45.514414 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Instance spawned successfully. Jun 03 01:05:45.515206 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:05:45.637933 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:05:45.992114 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-944176e9-88e8-4204-b8ff-c8a6880cb0fc tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:46.013974 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:46.015927 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:46.021423 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:46.021611 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:46.021879 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:46.022113 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:46.022410 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:46.022729 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:05:46.239594 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:46.239915 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:46.520105 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:05:46.520576 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Removed pending STOPPED event for cbb3ba9a-f26f-40c4-ac5b-00470740fd96 due to new event Resumed> {{(pid=98288) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 03 01:05:46.520576 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:46.520576 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] VM Resumed (Lifecycle Event) Jun 03 01:05:46.528907 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Took 12.72 seconds to spawn the instance on the hypervisor. Jun 03 01:05:46.529083 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:46.649519 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Found WWN 33000000092c49b1c for multipath device dm-1 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:05:46.649872 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:46.650066 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '33000000092c49b1c', 'path': '/dev/dm-1', 'multipath_id': '33000000092c49b1c'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:46.650205 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000092c49b1c', 'path': '/dev/dm-1', 'multipath_id': '33000000092c49b1c'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:05:46.650702 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.221s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:46.650961 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:05:46.656379 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:46.656379 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:46.656379 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:46.656379 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:46.656379 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] No waiting events found dispatching network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:46.656379 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received unexpected event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 for instance with vm_state rescued and task_state None. Jun 03 01:05:46.656379 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:46.656561 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:46.656688 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:46.657327 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:46.657512 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] No waiting events found dispatching network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:46.657681 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received unexpected event network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 for instance with vm_state rescued and task_state None. Jun 03 01:05:46.657825 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:46.658405 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lazy-loading 'flavor' on Instance uuid 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:46.659295 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:46.659541 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:46.659856 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:46.660018 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] No waiting events found dispatching network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:46.660274 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-e70f7e03-ec8f-43ef-aa1f-773d5d6015dd req-081891e2-fdb2-442e-88a0-12392b75c01c service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received unexpected event network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 for instance with vm_state rescued and task_state None. Jun 03 01:05:46.667596 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:46.668092 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:46.668335 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:05:46.669854 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:46.670371 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:46.670668 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:05:46.682953 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:05:46.682953 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:46.689459 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:05:46.689459 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:46.696721 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1] added Jun 03 01:05:46.696721 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:05:46.696721 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:46.696721 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:46.696721 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:46.696721 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:46.696721 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:46.697407 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:05:46.697895 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:05:46.698080 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:05:46.704701 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1] added Jun 03 01:05:46.704701 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:05:46.704701 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:46.704701 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:46.704701 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:46.704701 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:46.704701 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:46.704860 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:05:46.705136 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:05:46.706736 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:05:46.742465 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:05:47.022701 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:47.026283 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:47.040136 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Took 23.78 seconds to build instance. Jun 03 01:05:47.163843 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Attempting to attach volume 38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98288) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 03 01:05:47.164947 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] attach device xml: Jun 03 01:05:47.164947 np0000002000 nova-compute[98288]: Jun 03 01:05:47.164947 np0000002000 nova-compute[98288]: Jun 03 01:05:47.164947 np0000002000 nova-compute[98288]: Jun 03 01:05:47.164947 np0000002000 nova-compute[98288]: Jun 03 01:05:47.164947 np0000002000 nova-compute[98288]: 38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 Jun 03 01:05:47.164947 np0000002000 nova-compute[98288]: Jun 03 01:05:47.164947 np0000002000 nova-compute[98288]: {{(pid=98288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 03 01:05:47.293200 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:47.293364 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:47.296582 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:05:47.296759 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Claim successful on node np0000002000 Jun 03 01:05:47.467394 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-648e37ee-f777-465c-9cec-1a01bdff197d tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Unrescuing Jun 03 01:05:47.467640 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-648e37ee-f777-465c-9cec-1a01bdff197d tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "refresh_cache-cbb3ba9a-f26f-40c4-ac5b-00470740fd96" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:47.467776 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-648e37ee-f777-465c-9cec-1a01bdff197d tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquired lock "refresh_cache-cbb3ba9a-f26f-40c4-ac5b-00470740fd96" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:47.467967 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-648e37ee-f777-465c-9cec-1a01bdff197d tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:05:47.528677 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 03 01:05:47.529095 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:47.529095 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] VM Started (Lifecycle Event) Jun 03 01:05:47.542044 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-016a5f42-aae9-4238-84c5-202b1411ea3e tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "5fa25fea-9624-4611-8579-d6891f822679" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 25.304s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:47.563291 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d6fcbc45-7b90-48a4-a6eb-824a56193ce9 req-4a6bc379-b1b8-4cef-b91f-cb39ed00d3d1 service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:47.563426 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d6fcbc45-7b90-48a4-a6eb-824a56193ce9 req-4a6bc379-b1b8-4cef-b91f-cb39ed00d3d1 service nova] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:47.564040 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d6fcbc45-7b90-48a4-a6eb-824a56193ce9 req-4a6bc379-b1b8-4cef-b91f-cb39ed00d3d1 service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:47.564040 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d6fcbc45-7b90-48a4-a6eb-824a56193ce9 req-4a6bc379-b1b8-4cef-b91f-cb39ed00d3d1 service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:47.564040 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d6fcbc45-7b90-48a4-a6eb-824a56193ce9 req-4a6bc379-b1b8-4cef-b91f-cb39ed00d3d1 service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] No waiting events found dispatching network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:47.564040 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-d6fcbc45-7b90-48a4-a6eb-824a56193ce9 req-4a6bc379-b1b8-4cef-b91f-cb39ed00d3d1 service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received unexpected event network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd for instance with vm_state active and task_state None. Jun 03 01:05:47.698474 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:05:47.707147 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:47.720863 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:47.732433 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:47.740859 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:47.746687 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:47.755797 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.755797 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.755797 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.755797 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.755797 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:47.755964 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.755964 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.755964 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.755964 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.755964 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:47.762551 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.762551 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.762551 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.762551 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.762551 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:47.762757 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.762757 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.762757 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.762757 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.762757 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:47.804460 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.40.100,3260] Jun 03 01:05:47.804460 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.40.100,3260] successful. Jun 03 01:05:47.804460 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:47.814221 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.50.100,3260] Jun 03 01:05:47.814221 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.50.100,3260] successful. Jun 03 01:05:47.814221 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:47.822389 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:47.826540 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:47.829776 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:47.840272 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:47.840272 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.840272 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.840272 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.840272 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.840272 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:47.840272 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:47.840576 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:47.840576 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.840576 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.840576 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.840576 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.840576 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:47.840576 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:47.840691 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:47.840757 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:47.841486 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] HCTL ('11', '-', '-', 0) found on session 9 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:47.841685 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:47.848417 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:47.848417 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.848417 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.848417 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.848417 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.848417 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:47.848417 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:47.848907 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:47.848907 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.848907 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:47.848907 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.848907 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:47.848907 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:47.848907 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:47.848907 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:47.849104 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:47.849703 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] HCTL ('12', '-', '-', 0) found on session 10 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:47.849800 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:47.859797 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:47.860012 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:47.867020 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:47.867020 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:47.970607 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-648e37ee-f777-465c-9cec-1a01bdff197d tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:48.032580 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:48.039360 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:48.269954 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-648e37ee-f777-465c-9cec-1a01bdff197d tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:48.419401 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-648e37ee-f777-465c-9cec-1a01bdff197d tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Updating instance_info_cache with network_info: [{"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:48.513293 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Rescuing Jun 03 01:05:48.513423 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "refresh_cache-5fa25fea-9624-4611-8579-d6891f822679" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:48.513632 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquired lock "refresh_cache-5fa25fea-9624-4611-8579-d6891f822679" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:48.514047 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:05:48.544844 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 03 01:05:48.672035 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:05:48.829506 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:48.829506 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:48.829506 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:48.829506 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] No VIF found with MAC fa:16:3e:d9:fd:f9, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:05:48.869820 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:05:48.870041 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:05:48.908920 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:48.921770 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-648e37ee-f777-465c-9cec-1a01bdff197d tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Releasing lock "refresh_cache-cbb3ba9a-f26f-40c4-ac5b-00470740fd96" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:48.922189 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-648e37ee-f777-465c-9cec-1a01bdff197d tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'flavor' on Instance uuid cbb3ba9a-f26f-40c4-ac5b-00470740fd96 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:49.018137 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:49.289688 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:49.372461 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:05:49.418948 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Updating instance_info_cache with network_info: [{"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:49.450019 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:49.452065 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:49.473024 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:49.590631 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-049aa588-c7bd-4150-b8b9-913880a6a32a req-0640da69-d45a-43f7-8577-e37d05bebc4f service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:49.591035 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-049aa588-c7bd-4150-b8b9-913880a6a32a req-0640da69-d45a-43f7-8577-e37d05bebc4f service nova] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:49.591187 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-049aa588-c7bd-4150-b8b9-913880a6a32a req-0640da69-d45a-43f7-8577-e37d05bebc4f service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:49.591286 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-049aa588-c7bd-4150-b8b9-913880a6a32a req-0640da69-d45a-43f7-8577-e37d05bebc4f service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:49.591409 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-049aa588-c7bd-4150-b8b9-913880a6a32a req-0640da69-d45a-43f7-8577-e37d05bebc4f service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] No waiting events found dispatching network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:49.591550 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-049aa588-c7bd-4150-b8b9-913880a6a32a req-0640da69-d45a-43f7-8577-e37d05bebc4f service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received unexpected event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 for instance with vm_state rescued and task_state unrescuing. Jun 03 01:05:49.595940 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:49.600891 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:49.687203 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Found WWN 3300000004792dc3e for multipath device dm-2 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:05:49.687422 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:49.687581 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] <== connect_volume: return (4257ms) {'type': 'block', 'scsi_wwn': '3300000004792dc3e', 'path': '/dev/dm-2', 'multipath_id': '3300000004792dc3e'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:49.687685 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004792dc3e', 'path': '/dev/dm-2', 'multipath_id': '3300000004792dc3e'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:05:49.689765 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lazy-loading 'flavor' on Instance uuid 1225d1ad-70c5-43e1-b8f0-927efb3ef6be {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:49.729783 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:49.739203 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:49.761211 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.99972499799992 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:49.763618 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Instance destroyed successfully. Jun 03 01:05:49.764432 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-648e37ee-f777-465c-9cec-1a01bdff197d tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'numa_topology' on Instance uuid cbb3ba9a-f26f-40c4-ac5b-00470740fd96 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:49.775917 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:49.776048 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:49.879244 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.586s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:49.879516 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:05:49.920764 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Releasing lock "refresh_cache-5fa25fea-9624-4611-8579-d6891f822679" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:50.192102 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Attempting to attach volume 0782cb8d-527b-47ac-898d-a53b667d4af1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98288) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 03 01:05:50.195171 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] attach device xml: Jun 03 01:05:50.195171 np0000002000 nova-compute[98288]: Jun 03 01:05:50.195171 np0000002000 nova-compute[98288]: Jun 03 01:05:50.195171 np0000002000 nova-compute[98288]: Jun 03 01:05:50.195171 np0000002000 nova-compute[98288]: Jun 03 01:05:50.195171 np0000002000 nova-compute[98288]: 0782cb8d-527b-47ac-898d-a53b667d4af1 Jun 03 01:05:50.195171 np0000002000 nova-compute[98288]: Jun 03 01:05:50.195171 np0000002000 nova-compute[98288]: {{(pid=98288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 03 01:05:50.257637 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-323e4b77-7be0-46f6-bf65-07330dc8f622 tempest-VolumesAssistedSnapshotsTest-1753304758 tempest-VolumesAssistedSnapshotsTest-1753304758-project] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] volume_snapshot_create: create_info: {'snapshot_id': 'fd87924d-8414-4230-b5cb-79de66d89205', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98288) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}} Jun 03 01:05:50.265460 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-648e37ee-f777-465c-9cec-1a01bdff197d tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:50.271644 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-323e4b77-7be0-46f6-bf65-07330dc8f622 tempest-VolumesAssistedSnapshotsTest-1753304758 tempest-VolumesAssistedSnapshotsTest-1753304758-project] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] snap xml: Jun 03 01:05:50.271644 np0000002000 nova-compute[98288]: Jun 03 01:05:50.271644 np0000002000 nova-compute[98288]: Jun 03 01:05:50.271644 np0000002000 nova-compute[98288]: Jun 03 01:05:50.271644 np0000002000 nova-compute[98288]: Jun 03 01:05:50.271644 np0000002000 nova-compute[98288]: Jun 03 01:05:50.271644 np0000002000 nova-compute[98288]: Jun 03 01:05:50.271644 np0000002000 nova-compute[98288]: Jun 03 01:05:50.271644 np0000002000 nova-compute[98288]: Jun 03 01:05:50.271644 np0000002000 nova-compute[98288]: {{(pid=98288) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}} Jun 03 01:05:50.271644 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-323e4b77-7be0-46f6-bf65-07330dc8f622 tempest-VolumesAssistedSnapshotsTest-1753304758 tempest-VolumesAssistedSnapshotsTest-1753304758-project] Lazy-loading 'system_metadata' on Instance uuid 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:50.281260 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lazy-loading 'flavor' on Instance uuid 697c41c0-3674-4c57-b793-7ab8a4abe82a {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:50.305585 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-983d3c8c-ebb2-42d9-862b-0a729d580273 tempest-VolumesAssistedSnapshotsTest-1753304758 tempest-VolumesAssistedSnapshotsTest-1753304758-project] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] volume_snapshot_delete: delete_info: {'volume_id': '38f1e407-1b32-410b-8b0a-ec5d2e30a3e8'} {{(pid=98288) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}} Jun 03 01:05:50.311663 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [None req-983d3c8c-ebb2-42d9-862b-0a729d580273 tempest-VolumesAssistedSnapshotsTest-1753304758 tempest-VolumesAssistedSnapshotsTest-1753304758-project] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type' Jun 03 01:05:50.311663 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Traceback (most recent call last): Jun 03 01:05:50.311663 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete Jun 03 01:05:50.311663 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] self._volume_snapshot_delete(context, instance, volume_id, Jun 03 01:05:50.311663 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete Jun 03 01:05:50.311663 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] if delete_info['type'] != 'qcow2': Jun 03 01:05:50.311663 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] ~~~~~~~~~~~^^^^^^^^ Jun 03 01:05:50.311663 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] KeyError: 'type' Jun 03 01:05:50.311663 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [None req-983d3c8c-ebb2-42d9-862b-0a729d580273 tempest-VolumesAssistedSnapshotsTest-1753304758 tempest-VolumesAssistedSnapshotsTest-1753304758-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found. Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver self._volume_snapshot_delete(context, instance, volume_id, Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver if delete_info['type'] != 'qcow2': Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ~~~~~~~~~~~^^^^^^^^ Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver KeyError: 'type' Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f1a4835f-9196-4384-9c1e-3aa75c012ec8) Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 03 01:05:50.359766 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.360768 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 03 01:05:50.360768 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 03 01:05:50.360768 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.360768 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 03 01:05:50.360768 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 03 01:05:50.360768 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.360768 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 03 01:05:50.360768 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 03 01:05:50.360768 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found. Jun 03 01:05:50.360768 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server [None req-983d3c8c-ebb2-42d9-862b-0a729d580273 tempest-VolumesAssistedSnapshotsTest-1753304758 tempest-VolumesAssistedSnapshotsTest-1753304758-project] Exception during message handling: KeyError: 'type' Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server raise self.value Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_delete(context, instance, volume_id, Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server raise self.value Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server self._volume_snapshot_delete(context, instance, volume_id, Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server if delete_info['type'] != 'qcow2': Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server ~~~~~~~~~~~^^^^^^^^ Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server KeyError: 'type' Jun 03 01:05:50.372090 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server Jun 03 01:05:50.390209 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:05:50.390209 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:05:50.390209 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:50.390209 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:50.392613 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-60ad8254-3dc8-4454-8301-8a61bacb0fb0 tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.516s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:50.475871 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5200a7ff60b4b65812c39efec311990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2da6faf29d4db18ccfc9a42a93ab7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:05:50.750709 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:50.776248 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-323e4b77-7be0-46f6-bf65-07330dc8f622 tempest-VolumesAssistedSnapshotsTest-1753304758 tempest-VolumesAssistedSnapshotsTest-1753304758-project] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 03 01:05:50.777499 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:50.788191 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [None req-323e4b77-7be0-46f6-bf65-07330dc8f622 tempest-VolumesAssistedSnapshotsTest-1753304758 tempest-VolumesAssistedSnapshotsTest-1753304758-project] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 03 01:05:50.788191 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Traceback (most recent call last): Jun 03 01:05:50.788191 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create Jun 03 01:05:50.788191 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 03 01:05:50.788191 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 03 01:05:50.788191 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 03 01:05:50.788191 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 03 01:05:50.788191 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 03 01:05:50.788191 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 03 01:05:50.788191 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Jun 03 01:05:50.788585 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [None req-323e4b77-7be0-46f6-bf65-07330dc8f622 tempest-VolumesAssistedSnapshotsTest-1753304758 tempest-VolumesAssistedSnapshotsTest-1753304758-project] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 03 01:05:50.788585 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Traceback (most recent call last): Jun 03 01:05:50.788585 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create Jun 03 01:05:50.788585 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] self._volume_snapshot_create(context, instance, guest, Jun 03 01:05:50.788585 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create Jun 03 01:05:50.788585 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 03 01:05:50.788585 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 03 01:05:50.788585 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 03 01:05:50.788585 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 03 01:05:50.788585 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 03 01:05:50.788585 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 03 01:05:50.788585 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver [None req-323e4b77-7be0-46f6-bf65-07330dc8f622 tempest-VolumesAssistedSnapshotsTest-1753304758 tempest-VolumesAssistedSnapshotsTest-1753304758-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot fd87924d-8414-4230-b5cb-79de66d89205 could not be found. Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver self._volume_snapshot_create(context, instance, guest, Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot fd87924d-8414-4230-b5cb-79de66d89205 could not be found. (HTTP 404) (Request-ID: req-a75d51d4-b889-4615-80d4-6fd2ab73c555) Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 03 01:05:50.826372 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot fd87924d-8414-4230-b5cb-79de66d89205 could not be found. Jun 03 01:05:50.827278 np0000002000 nova-compute[98288]: ERROR nova.virt.libvirt.driver Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server [None req-323e4b77-7be0-46f6-bf65-07330dc8f622 tempest-VolumesAssistedSnapshotsTest-1753304758 tempest-VolumesAssistedSnapshotsTest-1753304758-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server raise self.value Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_create(context, instance, volume_id, Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server raise self.value Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server self._volume_snapshot_create(context, instance, guest, Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 03 01:05:50.832459 np0000002000 nova-compute[98288]: ERROR oslo_messaging.rpc.server Jun 03 01:05:50.873032 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:50.893984 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:05:50.911316 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:50.913872 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:50.991237 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Successfully created port: c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:05:51.027708 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Acquiring lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:51.027961 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:51.291705 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.516s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:51.402830 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:05:51.504643 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Removed pending STOPPED event for cbb3ba9a-f26f-40c4-ac5b-00470740fd96 due to new event Resumed> {{(pid=98288) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 03 01:05:51.504826 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:51.504886 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] VM Resumed (Lifecycle Event) Jun 03 01:05:51.506396 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-648e37ee-f777-465c-9cec-1a01bdff197d tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:51.530418 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Detaching volume 38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 Jun 03 01:05:51.544967 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:51.548977 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:51.564577 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:51.568387 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Attempting to driver detach volume 38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 from mountpoint /dev/vdb Jun 03 01:05:51.571357 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Found disk vdb by alias ua-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:05:51.572787 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Found disk vdb by alias ua-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:05:51.572935 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Attempting to detach device vdb from instance 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 from the persistent domain config. {{(pid=98288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 03 01:05:51.573150 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] detach device xml: Jun 03 01:05:51.573150 np0000002000 nova-compute[98288]: Jun 03 01:05:51.573150 np0000002000 nova-compute[98288]: Jun 03 01:05:51.573150 np0000002000 nova-compute[98288]: Jun 03 01:05:51.573150 np0000002000 nova-compute[98288]: Jun 03 01:05:51.573150 np0000002000 nova-compute[98288]: 38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 Jun 03 01:05:51.573150 np0000002000 nova-compute[98288]:
Jun 03 01:05:51.573150 np0000002000 nova-compute[98288]: Jun 03 01:05:51.573150 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:05:51.578622 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Successfully detached device vdb from instance 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 from the persistent domain config. Jun 03 01:05:51.578840 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] (1/8): Attempting to detach device vdb with device alias ua-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 from instance 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 from the live domain config. {{(pid=98288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 03 01:05:51.579078 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] detach device xml: Jun 03 01:05:51.579078 np0000002000 nova-compute[98288]: Jun 03 01:05:51.579078 np0000002000 nova-compute[98288]: Jun 03 01:05:51.579078 np0000002000 nova-compute[98288]: Jun 03 01:05:51.579078 np0000002000 nova-compute[98288]: Jun 03 01:05:51.579078 np0000002000 nova-compute[98288]: 38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 Jun 03 01:05:51.579078 np0000002000 nova-compute[98288]:
Jun 03 01:05:51.579078 np0000002000 nova-compute[98288]: Jun 03 01:05:51.579078 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:05:51.656024 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:51.656805 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:51.657059 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:51.657269 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:51.657506 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] No waiting events found dispatching network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:51.657831 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received unexpected event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 for instance with vm_state active and task_state None. Jun 03 01:05:51.658043 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:51.659894 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:51.659894 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:51.659894 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:51.659894 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] No waiting events found dispatching network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:51.659894 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received unexpected event network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 for instance with vm_state active and task_state None. Jun 03 01:05:51.659894 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:51.659894 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:51.659894 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:51.659894 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:51.659894 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] No waiting events found dispatching network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:51.659894 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-7877361b-61e3-443b-a66f-45c92dbdaf85 req-b26d2a3c-5665-42f4-8b46-12491cc6c86a service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received unexpected event network-vif-plugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 for instance with vm_state active and task_state None. Jun 03 01:05:51.707035 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:51.711029 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b126ec67-f26a-4e56-b826-d04b2445e24a req-de6b1262-50de-434d-a170-936d1fd00181 service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:51.711029 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b126ec67-f26a-4e56-b826-d04b2445e24a req-de6b1262-50de-434d-a170-936d1fd00181 service nova] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:51.711116 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b126ec67-f26a-4e56-b826-d04b2445e24a req-de6b1262-50de-434d-a170-936d1fd00181 service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:51.712111 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b126ec67-f26a-4e56-b826-d04b2445e24a req-de6b1262-50de-434d-a170-936d1fd00181 service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:51.712111 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b126ec67-f26a-4e56-b826-d04b2445e24a req-de6b1262-50de-434d-a170-936d1fd00181 service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] No waiting events found dispatching network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:51.712111 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-b126ec67-f26a-4e56-b826-d04b2445e24a req-de6b1262-50de-434d-a170-936d1fd00181 service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received unexpected event network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd for instance with vm_state active and task_state rescuing. Jun 03 01:05:51.713636 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:51.863652 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Instance destroyed successfully. Jun 03 01:05:51.864170 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'numa_topology' on Instance uuid 5fa25fea-9624-4611-8579-d6891f822679 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:51.868839 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:51.869420 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:51.869628 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:51.869808 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] No VIF found with MAC fa:16:3e:ee:15:36, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:05:51.907003 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Booting with volume 9f4e6e13-762a-4df4-82c3-0f4e04b9b688 at /dev/vda Jun 03 01:05:51.955123 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:51.969734 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:05:51.989395 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:52.012308 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:52.016573 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:05:52.017698 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:05:52.019116 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:52.029225 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:05:52.030489 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feee:1536', 'fe80::fc16:3eff:feb8:822', 'fe80::3c26:53ff:feb3:4c94', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::fc16:3eff:fed9:ee44', 'fe80::10fa:b6ff:fe2c:a1ba', 'fe80::fc16:3eff:fed9:fdf9', 'fe80::489c:41ff:febd:1e4c', 'fe80::fc16:3eff:fe5c:d4cc', 'fe80::34c3:b7ff:fe30:cb04', 'fe80::fc16:3eff:fe7f:c107', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fe29:1d7b'] Jun 03 01:05:52.030635 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:05:52.032060 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:05:52.032060 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] <== get_connector_properties: return (75ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:52.032060 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Updating existing volume attachment record: f1b1909c-a3a7-4858-990d-1188ad05e4ee {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:05:52.149097 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 for instance 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 {{(pid=98288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 03 01:05:52.287363 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Successfully updated port: c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:05:52.368867 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Attempting a stable device rescue Jun 03 01:05:52.430348 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:52.430594 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:52.430820 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Attaching volume 03104a2f-0c03-48b4-b8b7-64cf99206c02 to /dev/sdc Jun 03 01:05:52.449320 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} Jun 03 01:05:52.453897 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Instance directory exists: not creating {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} Jun 03 01:05:52.454025 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Creating image(s) Jun 03 01:05:52.454533 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:52.454683 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "/opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:52.455134 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "/opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:52.455299 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5fa25fea-9624-4611-8579-d6891f822679 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:52.472319 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:52.483810 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:05:52.500506 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:52.525883 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:05:52.526057 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] VM Started (Lifecycle Event) Jun 03 01:05:52.528851 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:05:52.530229 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:05:52.537457 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:05:52.539416 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feee:1536', 'fe80::fc16:3eff:feb8:822', 'fe80::3c26:53ff:feb3:4c94', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::fc16:3eff:fed9:ee44', 'fe80::10fa:b6ff:fe2c:a1ba', 'fe80::fc16:3eff:fed9:fdf9', 'fe80::489c:41ff:febd:1e4c', 'fe80::fc16:3eff:fe5c:d4cc', 'fe80::34c3:b7ff:fe30:cb04', 'fe80::fc16:3eff:fe7f:c107', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fe29:1d7b'] Jun 03 01:05:52.539774 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:05:52.539890 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:05:52.540134 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] <== get_connector_properties: return (67ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:52.540329 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Updating existing volume attachment record: 460ed9f0-dd56-4006-92b2-dd3166308862 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:05:52.789407 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "refresh_cache-fd0a3a08-1a8c-482c-836a-19ac700c473f" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:52.789599 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquired lock "refresh_cache-fd0a3a08-1a8c-482c-836a-19ac700c473f" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:52.789814 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:05:52.828586 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:52.957310 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<5fa25fea-9624-4611-8579-d6891f822679> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:52.957763 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "3cf1b78605ccdff94ccc5dd54cb34ea8aa160052" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:52.957980 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "3cf1b78605ccdff94ccc5dd54cb34ea8aa160052" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:53.029315 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:05:53.032706 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:05:53.094652 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:05:53.095177 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03104a2f-0c03-48b4-b8b7-64cf99206c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:53.095353 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:53.095648 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:53.095868 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03104a2f-0c03-48b4-b8b7-64cf99206c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:05:53.108930 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:53.109270 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:53.109772 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:53.109997 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:05:53.110841 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:53.111018 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:05:53.122894 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:05:53.122894 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:53.127904 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:05:53.127904 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:53.137317 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02] added Jun 03 01:05:53.137317 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:05:53.137317 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:53.137317 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:53.137317 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:53.137317 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:53.137317 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:53.137758 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:05:53.137758 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:05:53.137875 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:05:53.143076 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02] added Jun 03 01:05:53.143076 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:05:53.143076 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:53.143076 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:53.143076 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:53.143076 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:53.143076 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:53.143223 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:05:53.143353 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:05:53.143499 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:05:53.282801 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004268139998657716 future=) was cancelled during its delay period, skipping {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:53.282971 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:53.283109 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=11.477838149000036 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:53.283149 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=11.477744908999966 future=) was cancelled while queued, skipping {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:53.283319 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:53.349962 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:05:53.441530 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4a8d6ab9-e6c1-41ea-8667-18159085489f tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.722s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:53.528601 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:53.536060 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999721451999903 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:53.536901 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Received event ua-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98288) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 03 01:05:53.538679 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.997102351999956 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:53.538821 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.996938442999863 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:05:53.544757 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Successfully detached device vdb from instance 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 from the live domain config. Jun 03 01:05:53.547081 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:05:53.547433 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:53.547741 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:53.666026 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Updating instance_info_cache with network_info: [{"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:53.717420 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-0f85fc6e-0c2a-4634-96e1-796a267a7b52 req-886ac847-f01c-4b37-8f91-128ad738d532 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event network-changed-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:53.717863 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-0f85fc6e-0c2a-4634-96e1-796a267a7b52 req-886ac847-f01c-4b37-8f91-128ad738d532 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Refreshing instance network info cache due to event network-changed-c4966a48-9680-4d94-b3d2-f1ffb52ae18f. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:05:53.718265 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-0f85fc6e-0c2a-4634-96e1-796a267a7b52 req-886ac847-f01c-4b37-8f91-128ad738d532 service nova] Acquiring lock "refresh_cache-fd0a3a08-1a8c-482c-836a-19ac700c473f" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:53.762604 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:53.767297 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:53.767633 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf1b78605ccdff94ccc5dd54cb34ea8aa160052.part --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:53.793284 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e58cc3ed-17d2-43c5-b977-f0e87d15ecaa req-af2db0aa-8c97-4a14-bb1d-1c3e1042e27b service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:53.795833 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e58cc3ed-17d2-43c5-b977-f0e87d15ecaa req-af2db0aa-8c97-4a14-bb1d-1c3e1042e27b service nova] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:53.796064 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e58cc3ed-17d2-43c5-b977-f0e87d15ecaa req-af2db0aa-8c97-4a14-bb1d-1c3e1042e27b service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:53.796193 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e58cc3ed-17d2-43c5-b977-f0e87d15ecaa req-af2db0aa-8c97-4a14-bb1d-1c3e1042e27b service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:53.796323 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e58cc3ed-17d2-43c5-b977-f0e87d15ecaa req-af2db0aa-8c97-4a14-bb1d-1c3e1042e27b service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] No waiting events found dispatching network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:05:53.796466 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-e58cc3ed-17d2-43c5-b977-f0e87d15ecaa req-af2db0aa-8c97-4a14-bb1d-1c3e1042e27b service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received unexpected event network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd for instance with vm_state active and task_state rescuing. Jun 03 01:05:53.863271 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf1b78605ccdff94ccc5dd54cb34ea8aa160052.part --force-share --output=json" returned: 0 in 0.095s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:53.863654 np0000002000 nova-compute[98288]: DEBUG nova.virt.images [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] 342597a5-8c8d-4480-9719-f78a79569730 was qcow2, converting to raw {{(pid=98288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 03 01:05:53.865310 np0000002000 nova-compute[98288]: DEBUG nova.privsep.utils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 03 01:05:53.865606 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3cf1b78605ccdff94ccc5dd54cb34ea8aa160052.part /opt/stack/data/nova/instances/_base/3cf1b78605ccdff94ccc5dd54cb34ea8aa160052.converted {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:53.912957 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:53.945290 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3cf1b78605ccdff94ccc5dd54cb34ea8aa160052.part /opt/stack/data/nova/instances/_base/3cf1b78605ccdff94ccc5dd54cb34ea8aa160052.converted" returned: 0 in 0.079s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:53.950210 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf1b78605ccdff94ccc5dd54cb34ea8aa160052.converted --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:54.025226 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf1b78605ccdff94ccc5dd54cb34ea8aa160052.converted --force-share --output=json" returned: 0 in 0.075s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:54.026321 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "3cf1b78605ccdff94ccc5dd54cb34ea8aa160052" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.068s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:54.026943 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:54.029832 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:54.031077 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "3cf1b78605ccdff94ccc5dd54cb34ea8aa160052" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:54.031471 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "3cf1b78605ccdff94ccc5dd54cb34ea8aa160052" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:54.031816 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:54.033976 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:05:54.034216 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf1b78605ccdff94ccc5dd54cb34ea8aa160052 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:54.110191 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cf1b78605ccdff94ccc5dd54cb34ea8aa160052 --force-share --output=json" returned: 0 in 0.075s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:54.110793 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3cf1b78605ccdff94ccc5dd54cb34ea8aa160052,backing_fmt=raw /opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.rescue {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:54.136305 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:05:54.138672 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:05:54.139331 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:05:54.139915 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Creating image(s) Jun 03 01:05:54.140513 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Did not create local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} Jun 03 01:05:54.140784 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Ensure instance console log exists: /opt/stack/data/nova/instances/fd0a3a08-1a8c-482c-836a-19ac700c473f/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:05:54.141168 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:54.141421 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:54.141778 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:54.143842 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:54.158685 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:54.161754 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:54.167044 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3cf1b78605ccdff94ccc5dd54cb34ea8aa160052,backing_fmt=raw /opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.rescue" returned: 0 in 0.056s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:54.167598 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "3cf1b78605ccdff94ccc5dd54cb34ea8aa160052" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.136s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:54.167862 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'migration_context' on Instance uuid 5fa25fea-9624-4611-8579-d6891f822679 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:54.169635 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Releasing lock "refresh_cache-fd0a3a08-1a8c-482c-836a-19ac700c473f" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:54.173491 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Instance network_info: |[{"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:05:54.177034 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:54.179085 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-0f85fc6e-0c2a-4634-96e1-796a267a7b52 req-886ac847-f01c-4b37-8f91-128ad738d532 service nova] Acquired lock "refresh_cache-fd0a3a08-1a8c-482c-836a-19ac700c473f" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:54.181505 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Start _get_guest_xml network_info=[{"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'f1b1909c-a3a7-4858-990d-1188ad05e4ee', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fd0a3a08-1a8c-482c-836a-19ac700c473f', 'attached_at': '', 'detached_at': '', 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'serial': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:05:54.182334 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-0f85fc6e-0c2a-4634-96e1-796a267a7b52 req-886ac847-f01c-4b37-8f91-128ad738d532 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Refreshing network info cache for port c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:05:54.185880 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:54.193528 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:05:54.195256 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1203236219', uuid='fd0a3a08-1a8c-482c-836a-19ac700c473f'), owner=OwnerMeta(userid='d5200a7ff60b4b65812c39efec311990', username='tempest-ServerActionsV293TestJSON-378692121-project-member', projectid='ae2da6faf29d4db18ccfc9a42a93ab7d', projectname='tempest-ServerActionsV293TestJSON-378692121'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448754.1946921) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:05:54.200022 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:05:54.200619 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.200619 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.200619 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.200619 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.200619 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.200619 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.200619 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.200619 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.200619 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:54.201130 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.201130 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.201130 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.201130 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.201130 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.201130 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.201130 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.201130 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.201130 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:54.202842 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:05:54.203422 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:05:54.203677 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:05:54.204649 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:05:54.204972 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:05:54.205181 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:05:54.205318 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:05:54.206501 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:05:54.206501 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:05:54.206501 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:05:54.206501 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:05:54.206501 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:05:54.206501 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:05:54.206882 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:05:54.207071 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:05:54.216233 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.216233 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.216233 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.216233 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.216233 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.216233 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.216233 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.216233 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.216233 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:54.218468 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.218468 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.218468 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.218468 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.218468 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.218468 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.218468 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.218468 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.218468 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:54.222484 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:05:54.222484 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:54.222484 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:54.248248 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02, portal: 192.168.50.100,3260] Jun 03 01:05:54.248248 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02, portal: 192.168.50.100,3260] successful. Jun 03 01:05:54.248248 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:54.263989 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:54.272289 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02, portal: 192.168.40.100,3260] Jun 03 01:05:54.272289 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02, portal: 192.168.40.100,3260] successful. Jun 03 01:05:54.272289 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.283084 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:54.283947 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:54.283947 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:54.283947 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:54.285707 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] HCTL ('15', '-', '-', 0) found on session 13 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:54.285855 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:54.304090 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.304090 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.304090 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.304090 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:54.304090 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:54.304090 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.304090 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.304090 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.304090 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.304090 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.304090 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:54.304428 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.304428 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.304428 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:54.304428 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:54.304428 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:54.304428 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.304428 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:54.304428 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.304428 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:54.304428 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:54.304428 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:54.304760 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:54.304760 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:54.305248 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Searching for a device in session 13 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:54.305457 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '03104a2f-0c03-48b4-b8b7-64cf99206c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:54.307546 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] HCTL ('16', '-', '-', 0) found on session 14 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:54.307772 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:54.322864 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Searching for a device in session 14 and hctl ['16', '*', '*', 0] yield: None {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:54.670950 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<5fa25fea-9624-4611-8579-d6891f822679> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:54.671187 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:05:54.671791 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Start _get_guest_xml network_info=[{"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "vif_mac": "fa:16:3e:e5:47:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue={'image_id': '342597a5-8c8d-4480-9719-f78a79569730', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '8315294d-b7ca-404d-bd23-3ef76d7735af', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '5fa25fea-9624-4611-8579-d6891f822679', 'attached_at': '', 'detached_at': '', 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'serial': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:05:54.671943 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'resources' on Instance uuid 5fa25fea-9624-4611-8579-d6891f822679 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:54.689215 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-0f85fc6e-0c2a-4634-96e1-796a267a7b52 req-886ac847-f01c-4b37-8f91-128ad738d532 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:54.999024 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-0f85fc6e-0c2a-4634-96e1-796a267a7b52 req-886ac847-f01c-4b37-8f91-128ad738d532 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:55.141910 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-0f85fc6e-0c2a-4634-96e1-796a267a7b52 req-886ac847-f01c-4b37-8f91-128ad738d532 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Updated VIF entry in instance network info cache for port c4966a48-9680-4d94-b3d2-f1ffb52ae18f. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:05:55.142338 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-0f85fc6e-0c2a-4634-96e1-796a267a7b52 req-886ac847-f01c-4b37-8f91-128ad738d532 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Updating instance_info_cache with network_info: [{"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:55.175848 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<5fa25fea-9624-4611-8579-d6891f822679> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:55.177424 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:05:55.178458 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-598665403', uuid='5fa25fea-9624-4611-8579-d6891f822679'), owner=OwnerMeta(userid='6a5f52b75bd44cd880fcd26870d24190', username='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member', projectid='e3b5c165c8b142b6af1c20eeac918eb0', projectname='tempest-ServerBootFromVolumeStableRescueTest-1020364370'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "vif_mac": "fa:16:3e:e5:47:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448755.1781747) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:05:55.181974 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:05:55.182326 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:05:55.182981 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:05:55.183177 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:05:55.183887 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:05:55.184182 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:05:55.184350 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:05:55.184492 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:05:55.184656 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:05:55.184787 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:05:55.184914 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:05:55.185102 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:05:55.185239 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:05:55.185388 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:05:55.185548 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:05:55.185722 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:05:55.185894 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5fa25fea-9624-4611-8579-d6891f822679 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:55.335869 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Searching for a device in session 14 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:55.335982 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03104a2f-0c03-48b4-b8b7-64cf99206c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:55.644079 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-0f85fc6e-0c2a-4634-96e1-796a267a7b52 req-886ac847-f01c-4b37-8f91-128ad738d532 service nova] Releasing lock "refresh_cache-fd0a3a08-1a8c-482c-836a-19ac700c473f" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:55.690766 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<5fa25fea-9624-4611-8579-d6891f822679> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:05:55.699726 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.config --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:55.771989 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.config --force-share --output=json" returned: 0 in 0.072s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:05:55.772566 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:55.772956 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "/opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:55.773694 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "/opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:55.774326 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:05:55.774853 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:55.775064 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:56.129282 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Found WWN 33000000010bc7ca2 for multipath device dm-4 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:05:56.131903 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:56.132115 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '33000000010bc7ca2', 'path': '/dev/dm-4', 'multipath_id': '33000000010bc7ca2'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:56.132277 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000010bc7ca2', 'path': '/dev/dm-4', 'multipath_id': '33000000010bc7ca2'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:05:56.133017 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.585s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:56.133553 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:05:56.133730 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:05:56.141100 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lazy-loading 'flavor' on Instance uuid 697c41c0-3674-4c57-b793-7ab8a4abe82a {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:56.164407 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:56.164407 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:56.164407 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:56.164407 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:56.164407 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:56.164407 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:56.164407 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:56.164407 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:56.164407 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:56.164407 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:56.164407 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:56.164957 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:56.164957 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:56.164957 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:56.164957 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:56.164957 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:56.164957 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:56.164957 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:56.164957 np0000002000 nova-compute[98288]: tcp: [7] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:56.164957 np0000002000 nova-compute[98288]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8 (non-flash) Jun 03 01:05:56.164957 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:56.164957 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:56.164957 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '9')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:05:56.165212 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', '8')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:05:56.167463 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8', '7')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:05:56.167959 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Resulting device map defaultdict(. at 0x73e7b01d58a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8'): ({'sdd'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:05:56.168253 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Removing multipathed devices sdd, sde {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:05:56.168927 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Flush multipath device 33000000092c49b1c {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:05:56.200830 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:05:56.257108 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:05:56.312771 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:05:56.312771 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] SCSI volumes sdd, sde have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:05:56.313418 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:05:56.324789 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:05:56.324977 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:05:56.336490 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:56.385144 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8, portal: 192.168.40.100,3260] Jun 03 01:05:56.385144 np0000002000 nova-compute[98288]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8, portal: 192.168.40.100,3260] successful. Jun 03 01:05:56.385144 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:56.404113 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:56.414711 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:56.455463 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:56.455665 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:56.457206 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8, portal: 192.168.50.100,3260] Jun 03 01:05:56.457206 np0000002000 nova-compute[98288]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-38f1e407-1b32-410b-8b0a-ec5d2e30a3e8, portal: 192.168.50.100,3260] successful. Jun 03 01:05:56.457206 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:56.461495 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d44bc140-4572-4e31-a665-236d3a63c9cd req-9ea5a31e-6286-4632-a08f-0d26857d0609 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Received event network-changed-d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:56.462084 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d44bc140-4572-4e31-a665-236d3a63c9cd req-9ea5a31e-6286-4632-a08f-0d26857d0609 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Refreshing instance network info cache due to event network-changed-d20d1283-77a1-445e-ae92-60ef3ff039d5. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:05:56.462471 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d44bc140-4572-4e31-a665-236d3a63c9cd req-9ea5a31e-6286-4632-a08f-0d26857d0609 service nova] Acquiring lock "refresh_cache-2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:56.462746 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d44bc140-4572-4e31-a665-236d3a63c9cd req-9ea5a31e-6286-4632-a08f-0d26857d0609 service nova] Acquired lock "refresh_cache-2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:56.462872 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-d44bc140-4572-4e31-a665-236d3a63c9cd req-9ea5a31e-6286-4632-a08f-0d26857d0609 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Refreshing network info cache for port d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:05:56.480964 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:56.481215 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:56.481576 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] <== disconnect_volume: return (2933ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:56.481738 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:05:56.485304 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.264s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:56.485304 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:05:56.496845 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:56.497934 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:56.498312 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:56.498600 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:05:56.499018 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:56.499239 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:05:56.508754 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:05:56.508754 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:56.513404 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:05:56.513404 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:56.520680 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688] added Jun 03 01:05:56.520680 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:05:56.520680 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:56.520680 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:56.520680 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:56.520680 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:56.520680 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:56.520680 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:05:56.520860 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0222(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:05:56.520997 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:05:56.528525 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688] added Jun 03 01:05:56.528525 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:05:56.528525 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:56.528525 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:56.528525 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:05:56.528525 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:05:56.528525 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:56.528700 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:05:56.528814 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:05:56.528942 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:05:56.645412 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] attach device xml: Jun 03 01:05:56.645412 np0000002000 nova-compute[98288]: Jun 03 01:05:56.645412 np0000002000 nova-compute[98288]: Jun 03 01:05:56.645412 np0000002000 nova-compute[98288]: Jun 03 01:05:56.645412 np0000002000 nova-compute[98288]: Jun 03 01:05:56.645412 np0000002000 nova-compute[98288]: 03104a2f-0c03-48b4-b8b7-64cf99206c02 Jun 03 01:05:56.645412 np0000002000 nova-compute[98288]:
Jun 03 01:05:56.645412 np0000002000 nova-compute[98288]: Jun 03 01:05:56.645412 np0000002000 nova-compute[98288]: {{(pid=98288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 03 01:05:56.814397 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Stashing vm_state: active {{(pid=98288) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} Jun 03 01:05:56.957928 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:05:56.969232 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-d44bc140-4572-4e31-a665-236d3a63c9cd req-9ea5a31e-6286-4632-a08f-0d26857d0609 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:57.035658 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lazy-loading 'flavor' on Instance uuid 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:57.135536 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:57.135716 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:57.250957 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-d44bc140-4572-4e31-a665-236d3a63c9cd req-9ea5a31e-6286-4632-a08f-0d26857d0609 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:57.376345 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:57.376583 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:57.391568 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-d44bc140-4572-4e31-a665-236d3a63c9cd req-9ea5a31e-6286-4632-a08f-0d26857d0609 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Updated VIF entry in instance network info cache for port d20d1283-77a1-445e-ae92-60ef3ff039d5. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:05:57.391568 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-d44bc140-4572-4e31-a665-236d3a63c9cd req-9ea5a31e-6286-4632-a08f-0d26857d0609 service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Updating instance_info_cache with network_info: [{"id": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "address": "fa:16:3e:7f:c1:07", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d1283-77", "ovs_interfaceid": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:57.501242 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:57.521842 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:05:57.529299 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:57.534204 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:57.541041 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:57.547555 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:57.552532 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:57.564942 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.564942 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.564942 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.564942 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.564942 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.564942 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.564942 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.564942 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.564942 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:57.565155 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.565155 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.565155 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.565155 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.565155 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.565155 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.565155 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.565155 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.565155 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:57.568859 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.568859 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.568859 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.568859 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.568859 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.568859 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.568859 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.568859 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.568859 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:57.569042 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.569042 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.569042 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.569042 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.569042 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.569042 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.569042 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.569042 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.569042 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:57.603800 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.40.100,3260] Jun 03 01:05:57.603800 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.40.100,3260] successful. Jun 03 01:05:57.603800 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:57.611201 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.50.100,3260] Jun 03 01:05:57.611201 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.50.100,3260] successful. Jun 03 01:05:57.611201 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:57.615123 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:57.622284 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:57.638674 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lazy-loading 'flavor' on Instance uuid 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:05:57.641458 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.641458 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.641458 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.641458 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.641458 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.641458 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:57.641458 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:57.641458 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.641458 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.641458 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.641458 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:57.641960 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.641960 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.641960 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.641960 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.641960 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.641960 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:57.641960 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:57.641960 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.641960 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.641960 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.641960 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:57.642223 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.642223 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.642223 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.642223 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.642223 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.642223 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:57.642223 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:57.642223 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.642223 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.642223 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.642223 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:57.642496 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:57.642496 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:57.643561 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] HCTL ('10', '-', '-', 0) found on session 16 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:57.643710 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:57.643943 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.643943 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.643943 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:57.643943 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.643943 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:57.643943 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:57.643943 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:57.643943 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.643943 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:57.643943 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:57.643943 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:57.644264 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:57.644607 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:57.645966 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] HCTL ('9', '-', '-', 0) found on session 15 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:57.646111 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:57.661074 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Searching for a device in session 16 and hctl ['10', '*', '*', 0] yield: sdd {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:57.661225 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:57.665055 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Searching for a device in session 15 and hctl ['9', '*', '*', 0] yield: None {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:57.830259 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:57.884064 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:05:57.884214 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Claim successful on node np0000002000 Jun 03 01:05:57.895831 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d44bc140-4572-4e31-a665-236d3a63c9cd req-9ea5a31e-6286-4632-a08f-0d26857d0609 service nova] Releasing lock "refresh_cache-2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:05:58.042062 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0f51e8d3-55c0-4d30-bea7-c689d5056b9c tempest-VolumesAssistedSnapshotsTest-1969524320 tempest-VolumesAssistedSnapshotsTest-1969524320-project-admin] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 7.014s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:58.354194 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] No BDM found with device name sda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:58.354659 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:58.354659 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:05:58.354713 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] No VIF found with MAC fa:16:3e:d9:ee:44, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:05:58.392812 np0000002000 nova-compute[98288]: INFO nova.compute.resource_tracker [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updating resource usage from migration 8708136b-03fb-48d0-97ba-1773f515e332 Jun 03 01:05:58.532583 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-11b5514b-eab6-403a-890a-e795ac2b3c8e req-c00a3ff4-8311-4066-a572-fb2580ce061e service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Received event network-changed-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:05:58.532853 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-11b5514b-eab6-403a-890a-e795ac2b3c8e req-c00a3ff4-8311-4066-a572-fb2580ce061e service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Refreshing instance network info cache due to event network-changed-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:05:58.533047 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-11b5514b-eab6-403a-890a-e795ac2b3c8e req-c00a3ff4-8311-4066-a572-fb2580ce061e service nova] Acquiring lock "refresh_cache-f448afac-6687-4a4a-84ff-b4478c316986" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:58.533279 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-11b5514b-eab6-403a-890a-e795ac2b3c8e req-c00a3ff4-8311-4066-a572-fb2580ce061e service nova] Acquired lock "refresh_cache-f448afac-6687-4a4a-84ff-b4478c316986" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:58.533560 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-11b5514b-eab6-403a-890a-e795ac2b3c8e req-c00a3ff4-8311-4066-a572-fb2580ce061e service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Refreshing network info cache for port c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:05:58.646215 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.510s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:58.665773 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Searching for a device in session 15 and hctl ['9', '*', '*', 0] yield: sde {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:58.665773 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:58.906713 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:05:58.906917 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:05:58.915409 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:05:59.035640 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-11b5514b-eab6-403a-890a-e795ac2b3c8e req-c00a3ff4-8311-4066-a572-fb2580ce061e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:59.343895 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-11b5514b-eab6-403a-890a-e795ac2b3c8e req-c00a3ff4-8311-4066-a572-fb2580ce061e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:05:59.412170 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:05:59.481838 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-11b5514b-eab6-403a-890a-e795ac2b3c8e req-c00a3ff4-8311-4066-a572-fb2580ce061e service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Updated VIF entry in instance network info cache for port c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:05:59.482051 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-11b5514b-eab6-403a-890a-e795ac2b3c8e req-c00a3ff4-8311-4066-a572-fb2580ce061e service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Updating instance_info_cache with network_info: [{"id": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "address": "fa:16:3e:5c:d4:cc", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ca89c7-5e", "ovs_interfaceid": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:05:59.512487 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Found WWN 330000000ddb5455d for multipath device dm-1 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:05:59.512737 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:59.512881 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] <== connect_volume: return (5292ms) {'type': 'block', 'scsi_wwn': '330000000ddb5455d', 'path': '/dev/dm-1', 'multipath_id': '330000000ddb5455d'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:59.513002 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ddb5455d', 'path': '/dev/dm-1', 'multipath_id': '330000000ddb5455d'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:05:59.513305 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.738s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:59.513596 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:05:59.525629 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:59.526397 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:05:59.526941 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:59.527235 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:05:59.527495 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:05:59.527902 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.startup = automatic Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.scan = manual Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:59.537473 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.startup = automatic Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.scan = manual Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:05:59.543951 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:59.548302 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:59.553777 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:05:59.562078 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:59.562078 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:59.562078 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:59.562078 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:59.562078 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:59.562078 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:59.562078 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:59.562078 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:59.562078 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:59.562078 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:59.562078 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:59.562628 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:59.562628 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:59.562628 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:59.562628 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:59.562628 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:59.562628 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:59.562628 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:59.562628 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:59.562628 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:59.562628 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:59.562628 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:59.562628 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.036s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:59.562628 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:59.563102 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] HCTL ('7', '0', '0', 0) found on session 3 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:59.563201 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.042s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:05:59.569457 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:05:59.570226 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching for a device in session 3 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:59.570226 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:59.570870 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] HCTL ('8', '0', '0', 0) found on session 4 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:05:59.571089 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:05:59.577776 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching for a device in session 4 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:05:59.577776 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:05:59.738806 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:59.738955 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:59.739137 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Attaching volume 3eebcb34-c093-4aee-a218-870a08a435c0 to /dev/vdb Jun 03 01:05:59.782634 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:05:59.790810 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Acquiring lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:59.791028 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:59.791260 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Acquiring lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:05:59.791469 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:59.791644 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:59.797464 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Terminating instance Jun 03 01:05:59.801158 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:05:59.823963 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:05:59.857674 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:05:59.857958 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:05:59.868705 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:05:59.869836 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feee:1536', 'fe80::fc16:3eff:feb8:822', 'fe80::3c26:53ff:feb3:4c94', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::fc16:3eff:fed9:ee44', 'fe80::10fa:b6ff:fe2c:a1ba', 'fe80::fc16:3eff:fed9:fdf9', 'fe80::489c:41ff:febd:1e4c', 'fe80::fc16:3eff:fe5c:d4cc', 'fe80::34c3:b7ff:fe30:cb04', 'fe80::fc16:3eff:fe7f:c107', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fe29:1d7b'] Jun 03 01:05:59.869968 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:05:59.870298 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:05:59.870298 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:05:59.870574 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Updating existing volume attachment record: 56b30d1f-2f1c-4dc2-9b96-cecab758f162 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:05:59.916074 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-428950e5-9741-44cd-bec6-096cf71f4d88 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.485s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:59.922663 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.546s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:05:59.926874 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.422s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:05:59.927109 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Migrating Jun 03 01:05:59.927368 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:05:59.927531 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:05:59.931494 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:05:59.931621 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Claim successful on node np0000002000 Jun 03 01:05:59.983907 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-11b5514b-eab6-403a-890a-e795ac2b3c8e req-c00a3ff4-8311-4066-a572-fb2580ce061e service nova] Releasing lock "refresh_cache-f448afac-6687-4a4a-84ff-b4478c316986" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:00.018759 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1203236219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serveractionsv293testjson-server-1203236219',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOg/hEenxdNX4Z4QcNELt5stRwXZTqpWqT/PnVuKXCyR5nUlt1GylsaLK+alFPxegCcwDcE1qtmOZmRjXIw2iSsxnqNGSTWidkIuhnCdIaEbbKV6LWajW9bpcLx4K00nA==',key_name='tempest-keypair-2103291389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae2da6faf29d4db18ccfc9a42a93ab7d',ramdisk_id='',reservation_id='r-1quzjl2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-378692121',owner_user_name='tempest-ServerActionsV293TestJSON-378692121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5200a7ff60b4b65812c39efec311990',uuid=fd0a3a08-1a8c-482c-836a-19ac700c473f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:00.019095 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Converting VIF {"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:00.019756 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:00.020495 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lazy-loading 'pci_devices' on Instance uuid fd0a3a08-1a8c-482c-836a-19ac700c473f {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:00.302735 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:06:00.330518 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:00.335236 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:00.358700 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:00.358700 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:00.360502 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:00.368088 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:00.400082 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:00.402892 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:00.429749 np0000002000 nova-compute[98288]: INFO nova.compute.rpcapi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72 Jun 03 01:06:00.430682 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:00.430910 np0000002000 nova-compute[98288]: DEBUG nova.compute.rpcapi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98288) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 03 01:06:00.449811 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:06:00.450155 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eebcb34-c093-4aee-a218-870a08a435c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:00.450404 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:00.509016 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-9677b58b-b168-450c-8c46-5b1797453a81 req-91b60b5b-7b97-4660-a42f-c03c76673b5d service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Received event network-vif-unplugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:00.509611 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-9677b58b-b168-450c-8c46-5b1797453a81 req-91b60b5b-7b97-4660-a42f-c03c76673b5d service nova] Acquiring lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:00.509862 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-9677b58b-b168-450c-8c46-5b1797453a81 req-91b60b5b-7b97-4660-a42f-c03c76673b5d service nova] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:00.510050 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-9677b58b-b168-450c-8c46-5b1797453a81 req-91b60b5b-7b97-4660-a42f-c03c76673b5d service nova] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:00.510232 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-9677b58b-b168-450c-8c46-5b1797453a81 req-91b60b5b-7b97-4660-a42f-c03c76673b5d service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] No waiting events found dispatching network-vif-unplugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:00.510413 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-9677b58b-b168-450c-8c46-5b1797453a81 req-91b60b5b-7b97-4660-a42f-c03c76673b5d service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Received event network-vif-unplugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] End _get_guest_xml xml= Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: fd0a3a08-1a8c-482c-836a-19ac700c473f Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: instance-0000000c Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 196608 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: tempest-ServerActionsV293TestJSON-server-1203236219 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 2026-06-03 01:05:54 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 192 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: True Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: tempest-ServerActionsV293TestJSON-378692121-project-member Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: tempest-ServerActionsV293TestJSON-378692121 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: fd0a3a08-1a8c-482c-836a-19ac700c473f Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: fd0a3a08-1a8c-482c-836a-19ac700c473f Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: hvm Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 128 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: 9f4e6e13-762a-4df4-82c3-0f4e04b9b688 Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: Jun 03 01:06:00.525049 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:06:00.531474 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:06:00.531474 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Preparing to wait for external event network-vif-plugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:00.531474 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:00.531474 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:00.531474 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:00.531781 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1203236219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serveractionsv293testjson-server-1203236219',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOg/hEenxdNX4Z4QcNELt5stRwXZTqpWqT/PnVuKXCyR5nUlt1GylsaLK+alFPxegCcwDcE1qtmOZmRjXIw2iSsxnqNGSTWidkIuhnCdIaEbbKV6LWajW9bpcLx4K00nA==',key_name='tempest-keypair-2103291389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae2da6faf29d4db18ccfc9a42a93ab7d',ramdisk_id='',reservation_id='r-1quzjl2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-378692121',owner_user_name='tempest-ServerActionsV293TestJSON-378692121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5200a7ff60b4b65812c39efec311990',uuid=fd0a3a08-1a8c-482c-836a-19ac700c473f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:00.531995 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Converting VIF {"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:00.532510 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:00.532804 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:00.533339 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:00.533746 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:00.534085 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:00.535077 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:00.535313 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c16380b1-9eb9-52fb-9b3a-ee6e50d665a9', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:00.539316 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:00.539316 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:00.547354 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:00.549757 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:00.549950 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4966a48-96, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:00.550255 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4966a48-96, col_values=(('qos', UUID('5d856a3d-93f6-400b-abeb-337e1f683761')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:00.550416 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4966a48-96, col_values=(('external_ids', {'iface-id': 'c4966a48-9680-4d94-b3d2-f1ffb52ae18f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:40:dc', 'vm-uuid': 'fd0a3a08-1a8c-482c-836a-19ac700c473f'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:00.553582 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:00.554730 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:00.564324 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:00.565575 np0000002000 nova-compute[98288]: INFO os_vif [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') Jun 03 01:06:00.636936 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999732712000196 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:00.641021 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Instance destroyed successfully. Jun 03 01:06:00.641521 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lazy-loading 'resources' on Instance uuid 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:00.862085 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Detaching volume 03104a2f-0c03-48b4-b8b7-64cf99206c02 Jun 03 01:06:00.897803 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Attempting to driver detach volume 03104a2f-0c03-48b4-b8b7-64cf99206c02 from mountpoint /dev/sdc Jun 03 01:06:00.900689 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Found disk sdc by alias ua-03104a2f-0c03-48b4-b8b7-64cf99206c02 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:06:00.901627 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Found disk sdc by alias ua-03104a2f-0c03-48b4-b8b7-64cf99206c02 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:06:00.901759 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Attempting to detach device sdc from instance 697c41c0-3674-4c57-b793-7ab8a4abe82a from the persistent domain config. {{(pid=98288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 03 01:06:00.901986 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] detach device xml: Jun 03 01:06:00.901986 np0000002000 nova-compute[98288]: Jun 03 01:06:00.901986 np0000002000 nova-compute[98288]: Jun 03 01:06:00.901986 np0000002000 nova-compute[98288]: Jun 03 01:06:00.901986 np0000002000 nova-compute[98288]: Jun 03 01:06:00.901986 np0000002000 nova-compute[98288]: 03104a2f-0c03-48b4-b8b7-64cf99206c02 Jun 03 01:06:00.901986 np0000002000 nova-compute[98288]:
Jun 03 01:06:00.901986 np0000002000 nova-compute[98288]: Jun 03 01:06:00.901986 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:06:00.906923 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Successfully detached device sdc from instance 697c41c0-3674-4c57-b793-7ab8a4abe82a from the persistent domain config. Jun 03 01:06:00.907118 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] (1/8): Attempting to detach device sdc with device alias ua-03104a2f-0c03-48b4-b8b7-64cf99206c02 from instance 697c41c0-3674-4c57-b793-7ab8a4abe82a from the live domain config. {{(pid=98288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 03 01:06:00.907368 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] detach device xml: Jun 03 01:06:00.907368 np0000002000 nova-compute[98288]: Jun 03 01:06:00.907368 np0000002000 nova-compute[98288]: Jun 03 01:06:00.907368 np0000002000 nova-compute[98288]: Jun 03 01:06:00.907368 np0000002000 nova-compute[98288]: Jun 03 01:06:00.907368 np0000002000 nova-compute[98288]: 03104a2f-0c03-48b4-b8b7-64cf99206c02 Jun 03 01:06:00.907368 np0000002000 nova-compute[98288]:
Jun 03 01:06:00.907368 np0000002000 nova-compute[98288]: Jun 03 01:06:00.907368 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:06:00.951688 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:00.951807 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquired lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:00.951938 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:06:01.062371 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Received event ua-03104a2f-0c03-48b4-b8b7-64cf99206c02> from libvirt while the driver is waiting for it; dispatched. {{(pid=98288) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 03 01:06:01.063533 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-03104a2f-0c03-48b4-b8b7-64cf99206c02 for instance 697c41c0-3674-4c57-b793-7ab8a4abe82a {{(pid=98288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 03 01:06:01.065374 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Successfully detached device sdc from instance 697c41c0-3674-4c57-b793-7ab8a4abe82a from the live domain config. Jun 03 01:06:01.066079 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:06:01.066329 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03104a2f-0c03-48b4-b8b7-64cf99206c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:01.066534 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:01.143705 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2130936346',display_name='tempest-VolumesAssistedSnapshotsTest-server-2130936346',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-volumesassistedsnapshotstest-server-2130936346',id=6,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIWZ+6rFnDIISVEJBhGUFE7eADqv8YEEzNOnPIoIyhpJxXUDK88KXzTr64TBkb9U29yDwrjAQ+WSTannzbKwNGEO+XD97GVOe3W+4Aakh5IFg76l8OKkApn0jEMOnO3Ow==',key_name='tempest-keypair-212004546',keypairs=,launch_index=0,launched_at=2026-06-03T01:05:01Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='321c47ec5882416fa2c077d65bcce48c',ramdisk_id='',reservation_id='r-els0wz36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1266849806',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1266849806-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82aac57c5a3748a48909892b77417b42',uuid=9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "address": "fa:16:3e:d9:fd:f9", "network": {"id": "aca22e29-c397-4c4f-a985-57057a027e42", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-933421303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321c47ec5882416fa2c077d65bcce48c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap384a12cb-fb", "ovs_interfaceid": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:06:01.144718 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Converting VIF {"id": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "address": "fa:16:3e:d9:fd:f9", "network": {"id": "aca22e29-c397-4c4f-a985-57057a027e42", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-933421303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "321c47ec5882416fa2c077d65bcce48c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap384a12cb-fb", "ovs_interfaceid": "384a12cb-fb42-4a82-8fa4-e199eb9c4675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:01.145201 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=384a12cb-fb42-4a82-8fa4-e199eb9c4675,network=Network(aca22e29-c397-4c4f-a985-57057a027e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384a12cb-fb') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:01.145927 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=384a12cb-fb42-4a82-8fa4-e199eb9c4675,network=Network(aca22e29-c397-4c4f-a985-57057a027e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384a12cb-fb') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:06:01.147429 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:01.147691 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap384a12cb-fb, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:01.150476 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:01.151158 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:01.160674 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:01.162968 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:01.163228 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10b5ef96-c2cb-4b28-b7f4-f6d946a2266f) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:01.163710 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:01.164161 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:01.172540 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:01.174242 np0000002000 nova-compute[98288]: INFO os_vif [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:fd:f9,bridge_name='br-int',has_traffic_filtering=True,id=384a12cb-fb42-4a82-8fa4-e199eb9c4675,network=Network(aca22e29-c397-4c4f-a985-57057a027e42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap384a12cb-fb') Jun 03 01:06:01.174626 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Deleting instance files /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1_del Jun 03 01:06:01.175275 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Deletion of /opt/stack/data/nova/instances/9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1_del complete Jun 03 01:06:01.458290 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:01.471524 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:06:01.471796 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:06:01.547196 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Found WWN 330000000681717e1 for multipath device dm-0 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:06:01.547566 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.034s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:01.547741 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] <== connect_volume: return (5773ms) {'type': 'block', 'scsi_wwn': '330000000681717e1', 'path': '/dev/dm-0', 'multipath_id': '330000000681717e1'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:01.547858 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000681717e1', 'path': '/dev/dm-0', 'multipath_id': '330000000681717e1'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:06:01.548517 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.098s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:01.548833 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eebcb34-c093-4aee-a218-870a08a435c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:06:01.562762 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:01.563746 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:01.564304 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:01.564486 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:01.564984 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:01.565247 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:01.575817 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:01.575817 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:01.581435 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:01.581435 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:01.588779 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0] added Jun 03 01:06:01.588779 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:01.588779 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:01.588779 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:01.588779 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:01.588779 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:01.588779 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:01.588988 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:01.589138 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:01.589295 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:01.594379 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0] added Jun 03 01:06:01.594379 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:01.594379 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:01.594379 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:01.594379 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:01.594379 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:01.594379 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:01.594575 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:01.594672 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:01.594786 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:01.680071 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Took 1.38 seconds to destroy the instance on the hypervisor. Jun 03 01:06:01.680776 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:06:01.681375 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:06:01.681479 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:06:01.681668 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:01.745005 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:01.776927 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:01.894841 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updating instance_info_cache with network_info: [{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:01.977520 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:06:02.055864 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-598665403',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-598665403',id=11,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-03T01:05:46Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-sdp2alb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:05:47Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=5fa25fea-9624-4611-8579-d6891f822679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "vif_mac": "fa:16:3e:e5:47:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:02.056033 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "vif_mac": "fa:16:3e:e5:47:da"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:02.056702 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:47:da,bridge_name='br-int',has_traffic_filtering=True,id=c9849bf1-2517-4a9c-8033-605596ac9dfd,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9849bf1-25') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:02.057647 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fa25fea-9624-4611-8579-d6891f822679 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:02.083934 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:02.086101 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:02.086101 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] No VIF found with MAC fa:16:3e:52:40:dc, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:06:02.086101 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Using config drive Jun 03 01:06:02.280043 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5cf670bb-bb28-4b08-94db-e4fc358b421c req-9775f30f-16a1-4292-aa58-8f100c1fbf54 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Received event network-vif-deleted-384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:02.280183 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-5cf670bb-bb28-4b08-94db-e4fc358b421c req-9775f30f-16a1-4292-aa58-8f100c1fbf54 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Neutron deleted interface 384a12cb-fb42-4a82-8fa4-e199eb9c4675; detaching it from the instance and deleting it from the info cache Jun 03 01:06:02.281526 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5cf670bb-bb28-4b08-94db-e4fc358b421c req-9775f30f-16a1-4292-aa58-8f100c1fbf54 service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Detach interface failed, port_id=384a12cb-fb42-4a82-8fa4-e199eb9c4675, reason: Instance 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:06:02.397830 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Releasing lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:02.483644 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.561s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:02.484081 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:06:02.559395 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<5fa25fea-9624-4611-8579-d6891f822679> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] End _get_guest_xml xml= Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 5fa25fea-9624-4611-8579-d6891f822679 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: instance-0000000b Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 196608 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-server-598665403 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 2026-06-03 01:05:55 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 192 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: True Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: bare Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: ide Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: pc Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-1020364370 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 5fa25fea-9624-4611-8579-d6891f822679 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 5fa25fea-9624-4611-8579-d6891f822679 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: hvm Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 128 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: 0f48e8a0-3cad-4972-9467-17b0c1c7bdef Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: Jun 03 01:06:02.560378 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:06:02.564287 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Instance destroyed successfully. Jun 03 01:06:02.568246 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bd20dca0-3425-4a3b-8db9-0c5d840c68cc req-ab71471f-4512-43e2-9b30-84d2514be36a service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Received event network-vif-unplugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:02.568246 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bd20dca0-3425-4a3b-8db9-0c5d840c68cc req-ab71471f-4512-43e2-9b30-84d2514be36a service nova] Acquiring lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:02.568246 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bd20dca0-3425-4a3b-8db9-0c5d840c68cc req-ab71471f-4512-43e2-9b30-84d2514be36a service nova] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:02.568246 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bd20dca0-3425-4a3b-8db9-0c5d840c68cc req-ab71471f-4512-43e2-9b30-84d2514be36a service nova] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:02.568246 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bd20dca0-3425-4a3b-8db9-0c5d840c68cc req-ab71471f-4512-43e2-9b30-84d2514be36a service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] No waiting events found dispatching network-vif-unplugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:02.568246 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bd20dca0-3425-4a3b-8db9-0c5d840c68cc req-ab71471f-4512-43e2-9b30-84d2514be36a service nova] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Received event network-vif-unplugged-384a12cb-fb42-4a82-8fa4-e199eb9c4675 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:06:02.593043 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:02.599515 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:02.600158 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:02.613173 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:02.614929 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:02.627889 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:02.632445 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:02.644826 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.644826 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.644826 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.644826 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.644826 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.644826 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.644826 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.644826 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.644826 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.644826 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.644826 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:02.645206 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.645206 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.645206 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.645206 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.645206 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.645206 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.645206 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.645206 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.645206 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.645206 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.645206 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:02.655343 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.655343 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.655343 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.655343 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.655343 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.655343 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.655343 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.655343 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.655343 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.655343 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.655343 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:02.655673 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.655673 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.655673 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.655673 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.655673 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.655673 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.655673 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.655673 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.655673 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.655673 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.655673 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:02.707161 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0, portal: 192.168.50.100,3260] Jun 03 01:06:02.707161 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0, portal: 192.168.50.100,3260] successful. Jun 03 01:06:02.707161 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:02.720503 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:02.726125 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0, portal: 192.168.40.100,3260] Jun 03 01:06:02.726125 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0, portal: 192.168.40.100,3260] successful. Jun 03 01:06:02.726125 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:02.727043 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:02.729558 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Creating config drive at /opt/stack/data/nova/instances/fd0a3a08-1a8c-482c-836a-19ac700c473f/disk.config Jun 03 01:06:02.735065 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fd0a3a08-1a8c-482c-836a-19ac700c473f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpea9651xx {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:02.748909 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.748909 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.748909 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.748909 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.748909 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.748909 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.748909 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.748909 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:02.748909 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:02.748909 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.748909 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.748909 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.748909 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:02.749874 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:02.752802 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.752802 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.752802 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.752802 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.752802 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.752802 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.752802 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.752802 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:02.752802 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:02.752802 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.752802 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.752802 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.752802 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:02.753420 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:02.753616 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:02.754788 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] HCTL ('17', '-', '-', 0) found on session 17 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:02.754919 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:02.768089 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.768089 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.768089 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.768089 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.768089 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.768089 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.768089 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.768089 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:02.768089 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:02.768089 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.768089 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.768089 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.768089 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:02.768452 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.768452 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.768452 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:02.768452 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.768452 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:02.768452 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.768452 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:02.768452 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:02.768452 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:02.768452 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.768452 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:02.768452 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:02.768452 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:02.768690 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:02.768690 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:02.769661 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] HCTL ('18', '-', '-', 0) found on session 18 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:02.769781 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:02.781361 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fd0a3a08-1a8c-482c-836a-19ac700c473f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpea9651xx" returned: 0 in 0.046s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:02.803307 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Searching for a device in session 18 and hctl ['18', '*', '*', 0] yield: sdl {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:02.803307 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eebcb34-c093-4aee-a218-870a08a435c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:02.803307 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Searching for a device in session 17 and hctl ['17', '*', '*', 0] yield: sdm {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:02.803307 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3eebcb34-c093-4aee-a218-870a08a435c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:02.832537 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:02.988540 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:06:02.988775 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:06:02.989123 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:02.989377 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:03.058677 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a97328826b194121a85a35b41129c1a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d71b7749b9b414ea4fb3ad943aebf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:06:03.200916 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:03.231513 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Took 1.55 seconds to deallocate network for instance. Jun 03 01:06:03.238655 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:03.322313 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:03.442200 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2d35f755-bc18-4f0c-b57d-e611b9252a53 req-7c87d544-1eed-4e91-8fc4-ffea559606b6 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event network-vif-plugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:03.442749 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2d35f755-bc18-4f0c-b57d-e611b9252a53 req-7c87d544-1eed-4e91-8fc4-ffea559606b6 service nova] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:03.442939 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2d35f755-bc18-4f0c-b57d-e611b9252a53 req-7c87d544-1eed-4e91-8fc4-ffea559606b6 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:03.443064 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2d35f755-bc18-4f0c-b57d-e611b9252a53 req-7c87d544-1eed-4e91-8fc4-ffea559606b6 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:03.443469 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2d35f755-bc18-4f0c-b57d-e611b9252a53 req-7c87d544-1eed-4e91-8fc4-ffea559606b6 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Processing event network-vif-plugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:06:03.494137 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:06:03.531312 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Successfully created port: 32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:06:03.549850 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:03.557630 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:03.562673 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:03.567578 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:06:03.584065 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:03.587766 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:03.743173 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:03.743360 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:03.909947 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Starting migrate_disk_and_power_off {{(pid=98288) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}} Jun 03 01:06:03.954272 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:03.961567 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:03.975743 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:03.995128 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:03.999747 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:06:04.024462 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:04.073068 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:04.075466 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:06:04.075466 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] VM Started (Lifecycle Event) Jun 03 01:06:04.079929 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:06:04.084927 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:04.084927 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:04.084927 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:04.090179 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No VIF found with MAC fa:16:3e:e5:47:da, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:06:04.092159 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Instance spawned successfully. Jun 03 01:06:04.094464 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Using config drive Jun 03 01:06:04.098111 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:06:04.125146 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Successfully updated port: 32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:06:04.266784 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Instance destroyed successfully. Jun 03 01:06:04.268046 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-690499922',display_name='tempest-ServerActionsTestOtherB-server-690499922',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serveractionstestotherb-server-690499922',id=3,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+EmDDwoR2OvmMWSLRL3pD12IuhLKXYlFCyFD0S6tz1U811/Ppz6LfRqvK84OL/tJp7AFM3OOYK27W8pAe9Ufj1wNI9CICCs+j8JCdUBCkwgtBDQJU6o6T6RKxEkHfeyw==',key_name='tempest-keypair-122608129',keypairs=,launch_index=0,launched_at=2026-06-03T01:05:00Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='64016d71af32442f8c9e0e2fc40a542b',ramdisk_id='',reservation_id='r-mvqoecge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1369156437',owner_user_name='tempest-ServerActionsTestOtherB-1369156437-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:05:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95a67614fa2443596fde71d819153e7',uuid=1225d1ad-70c5-43e1-b8f0-927efb3ef6be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1936602961-network", "vif_mac": "fa:16:3e:ee:15:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:06:04.268280 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converting VIF {"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1936602961-network", "vif_mac": "fa:16:3e:ee:15:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:04.269094 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:04.269390 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:06:04.272085 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:04.272085 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9055a094-dc, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:04.272813 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:04.275474 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:04.278346 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:04.279400 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:04.279600 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0df5e759-0046-43e6-87b5-62b73c9540ac) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:04.280068 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:04.280501 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:04.285918 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:04.288120 np0000002000 nova-compute[98288]: INFO os_vif [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') Jun 03 01:06:04.289109 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:06:04.289486 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:04.289655 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:04.369307 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-70e29126-f111-42e9-8e60-eac5ebda205e req-a3632d35-5661-448d-b98b-d03071eacaa4 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:04.369307 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-70e29126-f111-42e9-8e60-eac5ebda205e req-a3632d35-5661-448d-b98b-d03071eacaa4 service nova] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:04.369307 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-70e29126-f111-42e9-8e60-eac5ebda205e req-a3632d35-5661-448d-b98b-d03071eacaa4 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:04.369307 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-70e29126-f111-42e9-8e60-eac5ebda205e req-a3632d35-5661-448d-b98b-d03071eacaa4 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:04.369307 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-70e29126-f111-42e9-8e60-eac5ebda205e req-a3632d35-5661-448d-b98b-d03071eacaa4 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] No waiting events found dispatching network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:04.369307 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-70e29126-f111-42e9-8e60-eac5ebda205e req-a3632d35-5661-448d-b98b-d03071eacaa4 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received unexpected event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 for instance with vm_state active and task_state resize_migrating. Jun 03 01:06:04.477339 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:06:04.477541 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:06:04.581952 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Found WWN 3300000008a7288bf for multipath device dm-9 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:06:04.582395 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:04.582587 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] <== connect_volume: return (4131ms) {'type': 'block', 'scsi_wwn': '3300000008a7288bf', 'path': '/dev/dm-9', 'multipath_id': '3300000008a7288bf'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:04.582944 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008a7288bf', 'path': '/dev/dm-9', 'multipath_id': '3300000008a7288bf'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:06:04.583421 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.517s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:04.583829 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03104a2f-0c03-48b4-b8b7-64cf99206c02', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:06:04.584020 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:06:04.586371 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lazy-loading 'flavor' on Instance uuid 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:04.592656 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:04.594089 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:04.598222 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'ec2_ids' on Instance uuid 5fa25fea-9624-4611-8579-d6891f822679 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:04.607131 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:04.607249 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:04.607525 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:04.607718 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:04.607968 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:04.608203 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:04.614262 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:04.614262 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:04.614262 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:04.614262 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:04.614262 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:04.614262 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:04.614262 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:04.614262 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:04.614262 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:04.614262 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:04.614262 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:04.614262 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:04.614262 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:04.614602 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:04.614602 np0000002000 nova-compute[98288]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:04.614602 np0000002000 nova-compute[98288]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:04.614602 np0000002000 nova-compute[98288]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:04.614602 np0000002000 nova-compute[98288]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02 (non-flash) Jun 03 01:06:04.614602 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:04.614602 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:04.614602 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:04.614602 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:04.614602 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:04.614602 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:04.614602 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:04.614602 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:04.614811 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '9')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:06:04.614811 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', '14')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:04.616412 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02', '13')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:04.617720 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Resulting device map defaultdict(. at 0x73e7b82aa020>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02'): ({'sdj'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:06:04.618006 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Removing multipathed devices sdk, sdj {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:06:04.618572 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Flush multipath device 33000000010bc7ca2 {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:06:04.630275 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:04.630368 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquired lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:04.630508 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:06:04.656256 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:06:04.701617 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:06:04.743206 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:06:04.743600 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:06:04.745575 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:06:04.759196 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:06:04.759498 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:06:04.772915 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:04.805132 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02, portal: 192.168.40.100,3260] Jun 03 01:06:04.805132 np0000002000 nova-compute[98288]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02, portal: 192.168.40.100,3260] successful. Jun 03 01:06:04.805132 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:04.823312 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:04.833387 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:04.864101 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02, portal: 192.168.50.100,3260] Jun 03 01:06:04.864101 np0000002000 nova-compute[98288]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-03104a2f-0c03-48b4-b8b7-64cf99206c02, portal: 192.168.50.100,3260] successful. Jun 03 01:06:04.864101 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:04.887468 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:04.887745 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:04.887897 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] <== disconnect_volume: return (3821ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:04.888054 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:06:04.980333 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:06:05.008473 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:06:05.008952 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:06:05.009316 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Creating image(s) Jun 03 01:06:05.009894 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "/opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:05.010366 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "/opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:05.012709 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "/opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:05.012709 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:05.014513 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:05.015542 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:05.083121 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.067s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:05.085837 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:05.086303 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:05.087227 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:05.091287 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Attempting to attach volume 3eebcb34-c093-4aee-a218-870a08a435c0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98288) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 03 01:06:05.092593 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:05.092980 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:05.102185 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] attach device xml: Jun 03 01:06:05.102185 np0000002000 nova-compute[98288]: Jun 03 01:06:05.102185 np0000002000 nova-compute[98288]: Jun 03 01:06:05.102185 np0000002000 nova-compute[98288]: Jun 03 01:06:05.102185 np0000002000 nova-compute[98288]: Jun 03 01:06:05.102185 np0000002000 nova-compute[98288]: 3eebcb34-c093-4aee-a218-870a08a435c0 Jun 03 01:06:05.102185 np0000002000 nova-compute[98288]: Jun 03 01:06:05.102185 np0000002000 nova-compute[98288]: Jun 03 01:06:05.102185 np0000002000 nova-compute[98288]: {{(pid=98288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 03 01:06:05.104531 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:06:05.106503 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<5fa25fea-9624-4611-8579-d6891f822679> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:06:05.106782 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:05.107250 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'keypairs' on Instance uuid 5fa25fea-9624-4611-8579-d6891f822679 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:05.110213 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] VM Paused (Lifecycle Event) Jun 03 01:06:05.117868 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Took 10.98 seconds to spawn the instance on the hypervisor. Jun 03 01:06:05.117868 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:05.192307 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.099s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:05.192681 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:05.229296 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:06:05.241558 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk 1073741824" returned: 0 in 0.047s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:05.241558 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.155s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:05.241558 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:05.259478 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.969s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:05.260834 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:06:05.261083 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:06:05.303952 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:05.303952 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:05.303952 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:05.303952 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:05.303952 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:05.303952 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:05.303952 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:05.303952 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:05.303952 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:05.304219 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:05.304219 np0000002000 nova-compute[98288]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:05.304219 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:05.304219 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:05.304219 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:05.304219 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:05.304219 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:05.304219 np0000002000 nova-compute[98288]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:05.304219 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:05.304362 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '9')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:06:05.304564 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '9')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:05.305827 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '10')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:05.310267 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Resulting device map defaultdict(. at 0x73e7b01d5e40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'): ({'sdg'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:06:05.310632 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Removing multipathed devices sdf, sdg {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:06:05.311476 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Flush multipath device 3300000004792dc3e {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:06:05.341169 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.100s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:05.341814 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:06:05.342127 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:05.371613 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:06:05.430810 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:06:05.449815 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:05.451460 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Cannot resize image /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:06:05.451460 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:06:05.451769 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Ensure instance console log exists: /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:06:05.452133 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:05.452411 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:05.452616 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:05.464501 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lazy-loading 'flavor' on Instance uuid 697c41c0-3674-4c57-b793-7ab8a4abe82a {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:05.479669 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:06:05.479823 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:06:05.481361 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:06:05.489918 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.746s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:05.495598 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:05.497086 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:06:05.501460 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:06:05.511171 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:05.525856 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event network-vif-plugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:05.525929 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:05.526143 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:05.526303 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:05.526522 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] No waiting events found dispatching network-vif-plugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:05.527263 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received unexpected event network-vif-plugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f for instance with vm_state active and task_state None. Jun 03 01:06:05.527428 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-changed-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:05.527605 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Refreshing instance network info cache due to event network-changed-32c927ec-8321-4de0-9cd5-36aaf8f01e7e. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:05.527763 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] Acquiring lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:05.548955 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.40.100,3260] Jun 03 01:06:05.548955 np0000002000 nova-compute[98288]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.40.100,3260] successful. Jun 03 01:06:05.548955 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:05.562869 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Deleted allocations for instance 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1 Jun 03 01:06:05.565831 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:05.577956 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:05.609590 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.50.100,3260] Jun 03 01:06:05.609590 np0000002000 nova-compute[98288]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.50.100,3260] successful. Jun 03 01:06:05.609590 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:05.613209 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<5fa25fea-9624-4611-8579-d6891f822679> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:06:05.616636 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:05.616811 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:05.621597 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:05.621746 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] VM Resumed (Lifecycle Event) Jun 03 01:06:05.627976 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:05.628214 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:05.628326 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] <== disconnect_volume: return (1338ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:05.628428 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:06:05.631204 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:05.655044 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Took 18.41 seconds to build instance. Jun 03 01:06:05.699831 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Updating instance_info_cache with network_info: [{"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:05.718014 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:05.718417 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:05.763306 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Creating config drive at /opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.config.rescue Jun 03 01:06:05.766418 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9sxsyrxb {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:05.790388 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:05.791657 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} Jun 03 01:06:05.791687 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be_resize/disk /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:05.808042 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9sxsyrxb" returned: 0 in 0.041s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:05.885470 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "cp -r /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be_resize/disk /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk" returned: 0 in 0.094s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:05.885764 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be_resize/disk.config /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.config {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:05.911559 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "cp -r /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be_resize/disk.config /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.config" returned: 0 in 0.025s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:05.913314 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be_resize/disk.info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.info {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:05.944262 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "cp -r /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be_resize/disk.info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.info" returned: 0 in 0.032s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:06.124495 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:06.134330 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:06.157077 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 19.917s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:06.201830 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Releasing lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:06.202143 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Instance network_info: |[{"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:06:06.207024 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Start _get_guest_xml network_info=[{"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:06:06.207430 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] Acquired lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:06.207601 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Refreshing network info cache for port 32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:06.210974 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:06:06.211602 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-481754813', uuid='0584c6a8-64fc-4891-ba12-b8ede4275b95'), owner=OwnerMeta(userid='a97328826b194121a85a35b41129c1a9', username='tempest-ServerRescueNegativeTestJSON-335039479-project-member', projectid='8d71b7749b9b414ea4fb3ad943aebf49', projectname='tempest-ServerRescueNegativeTestJSON-335039479'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448766.2112474) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:06:06.212814 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:06:06.213173 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:06:06.214008 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:06:06.214154 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:06:06.215253 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:06:06.215565 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:06:06.215681 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:06:06.215783 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:06:06.215893 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:06:06.215970 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:06:06.216059 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:06:06.216270 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:06:06.216391 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:06:06.216519 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:06:06.216620 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:06:06.217453 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:06:06.230678 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-481754813',display_name='tempest-ServerRescueNegativeTestJSON-server-481754813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverrescuenegativetestjson-server-481754813',id=13,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL1bTBKcpZPABlrsAC0BEunnlWZIWUncp1/s0rBJZiMFQjI/YvZ2jDYP4Ergq3etXYSswYhNLR8uVFWr/Jo8efkJFJWEw+g8AUr5Em0kds/F9DhSJhBU+c6WxuFLkZllw==',key_name='tempest-keypair-1134454194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d71b7749b9b414ea4fb3ad943aebf49',ramdisk_id='',reservation_id='r-dhd481f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-335039479',owner_user_name='tempest-ServerRescueNegativeTestJSON-335039479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a97328826b194121a85a35b41129c1a9',uuid=0584c6a8-64fc-4891-ba12-b8ede4275b95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:06.230865 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converting VIF {"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:06.231845 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:4e:78,bridge_name='br-int',has_traffic_filtering=True,id=32c927ec-8321-4de0-9cd5-36aaf8f01e7e,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c927ec-83') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:06.233325 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'pci_devices' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:06.261627 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:06.288679 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:06.291066 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:06.414818 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:06.419396 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:06.423353 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:06.485314 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-a4c316ee-513e-4844-9353-82b4b1ed04ec req-de710767-dd42-44ed-9222-f5a856a1c533 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:06.487530 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-a4c316ee-513e-4844-9353-82b4b1ed04ec req-de710767-dd42-44ed-9222-f5a856a1c533 service nova] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:06.487530 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-a4c316ee-513e-4844-9353-82b4b1ed04ec req-de710767-dd42-44ed-9222-f5a856a1c533 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:06.487530 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-a4c316ee-513e-4844-9353-82b4b1ed04ec req-de710767-dd42-44ed-9222-f5a856a1c533 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:06.487530 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-a4c316ee-513e-4844-9353-82b4b1ed04ec req-de710767-dd42-44ed-9222-f5a856a1c533 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] No waiting events found dispatching network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:06.487530 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-a4c316ee-513e-4844-9353-82b4b1ed04ec req-de710767-dd42-44ed-9222-f5a856a1c533 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received unexpected event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 for instance with vm_state active and task_state resize_migrating. Jun 03 01:06:06.487928 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-54fb2a29-8440-447d-8219-e77e7c5f0805 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.130s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:06.578850 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-228659da-aa7b-4cfb-9b03-209f69cee7c6 tempest-VolumesAssistedSnapshotsTest-1266849806 tempest-VolumesAssistedSnapshotsTest-1266849806-project-member] Lock "9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.788s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:06.636567 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999712686000066 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:06.697177 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e14504e3-c37d-44aa-a0e1-d1774305a961 req-d51edbae-eb22-492a-9156-956c2cbbc8ef service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:06.697410 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e14504e3-c37d-44aa-a0e1-d1774305a961 req-d51edbae-eb22-492a-9156-956c2cbbc8ef service nova] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:06.697633 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e14504e3-c37d-44aa-a0e1-d1774305a961 req-d51edbae-eb22-492a-9156-956c2cbbc8ef service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:06.698626 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e14504e3-c37d-44aa-a0e1-d1774305a961 req-d51edbae-eb22-492a-9156-956c2cbbc8ef service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:06.698784 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e14504e3-c37d-44aa-a0e1-d1774305a961 req-d51edbae-eb22-492a-9156-956c2cbbc8ef service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] No waiting events found dispatching network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:06.698956 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-e14504e3-c37d-44aa-a0e1-d1774305a961 req-d51edbae-eb22-492a-9156-956c2cbbc8ef service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received unexpected event network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd for instance with vm_state active and task_state rescuing. Jun 03 01:06:06.709791 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] End _get_guest_xml xml= Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 0584c6a8-64fc-4891-ba12-b8ede4275b95 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: instance-0000000d Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 196608 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-server-481754813 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 2026-06-03 01:06:06 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 192 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: True Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: bare Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-335039479-project-member Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-335039479 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 0584c6a8-64fc-4891-ba12-b8ede4275b95 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 0584c6a8-64fc-4891-ba12-b8ede4275b95 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: hvm Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 128 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: Jun 03 01:06:06.737655 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:06:06.740731 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Preparing to wait for external event network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:06.740731 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:06.740731 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:06.740731 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:06.740731 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-481754813',display_name='tempest-ServerRescueNegativeTestJSON-server-481754813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverrescuenegativetestjson-server-481754813',id=13,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL1bTBKcpZPABlrsAC0BEunnlWZIWUncp1/s0rBJZiMFQjI/YvZ2jDYP4Ergq3etXYSswYhNLR8uVFWr/Jo8efkJFJWEw+g8AUr5Em0kds/F9DhSJhBU+c6WxuFLkZllw==',key_name='tempest-keypair-1134454194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d71b7749b9b414ea4fb3ad943aebf49',ramdisk_id='',reservation_id='r-dhd481f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-335039479',owner_user_name='tempest-ServerRescueNegativeTestJSON-335039479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a97328826b194121a85a35b41129c1a9',uuid=0584c6a8-64fc-4891-ba12-b8ede4275b95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:06.741348 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converting VIF {"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:06.741348 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:4e:78,bridge_name='br-int',has_traffic_filtering=True,id=32c927ec-8321-4de0-9cd5-36aaf8f01e7e,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c927ec-83') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:06.741561 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:4e:78,bridge_name='br-int',has_traffic_filtering=True,id=32c927ec-8321-4de0-9cd5-36aaf8f01e7e,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c927ec-83') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:06.741843 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:06.741962 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:06.742168 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:06.745542 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:06.745701 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6558503e-02f0-507a-85d0-92168d409ce0', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:06.747078 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:06.747979 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:06.748118 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:06.749891 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:06.750076 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32c927ec-83, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:06.750401 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32c927ec-83, col_values=(('qos', UUID('f6688abf-410a-4755-925a-8b9d7db84a81')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:06.750607 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32c927ec-83, col_values=(('external_ids', {'iface-id': '32c927ec-8321-4de0-9cd5-36aaf8f01e7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:4e:78', 'vm-uuid': '0584c6a8-64fc-4891-ba12-b8ede4275b95'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:06.751471 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:06.753831 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:06.758387 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:06.759475 np0000002000 nova-compute[98288]: INFO os_vif [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:4e:78,bridge_name='br-int',has_traffic_filtering=True,id=32c927ec-8321-4de0-9cd5-36aaf8f01e7e,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c927ec-83') Jun 03 01:06:06.795633 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:06.795633 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:06.795633 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:06.795633 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No VIF found with MAC fa:16:3e:7f:c1:07, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:06:06.931818 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:06.932036 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:06.932256 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:06.932432 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:06.932602 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:06.935275 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Terminating instance Jun 03 01:06:07.038837 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:07.120747 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:07.121010 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:07.146876 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Removed pending STOPPED event for 5fa25fea-9624-4611-8579-d6891f822679 due to new event Resumed> {{(pid=98288) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 03 01:06:07.147052 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:07.147196 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] VM Resumed (Lifecycle Event) Jun 03 01:06:07.152927 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-0d1205f4-87b1-4e7d-b5b4-6dda181bd81b tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:07.168246 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Updated VIF entry in instance network info cache for port 32c927ec-8321-4de0-9cd5-36aaf8f01e7e. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:06:07.168645 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Updating instance_info_cache with network_info: [{"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:07.193967 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Port 9055a094-dc81-45da-9637-48b820c58772 binding to destination host np0000002000 is already ACTIVE {{(pid=98288) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 03 01:06:07.447158 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:06:07.487570 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:07.490090 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:07.513384 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:07.524940 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:07.554047 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:07.652827 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:07.661050 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:07.671620 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8119ba11-b6f2-412f-9dc0-4623221a50df req-535df819-0f9e-4a7d-bd6b-447fdf49376f service nova] Releasing lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:07.687561 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4a845fbd-1de0-4ac0-9a14-d23f6ef02f45 req-a50a2c1d-ccfc-43f5-aef4-9d84d039f4bd service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Received event network-vif-unplugged-6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:07.687561 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4a845fbd-1de0-4ac0-9a14-d23f6ef02f45 req-a50a2c1d-ccfc-43f5-aef4-9d84d039f4bd service nova] Acquiring lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:07.687561 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4a845fbd-1de0-4ac0-9a14-d23f6ef02f45 req-a50a2c1d-ccfc-43f5-aef4-9d84d039f4bd service nova] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:07.687719 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-4a845fbd-1de0-4ac0-9a14-d23f6ef02f45 req-a50a2c1d-ccfc-43f5-aef4-9d84d039f4bd service nova] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:07.687780 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4a845fbd-1de0-4ac0-9a14-d23f6ef02f45 req-a50a2c1d-ccfc-43f5-aef4-9d84d039f4bd service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] No waiting events found dispatching network-vif-unplugged-6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:07.687930 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-4a845fbd-1de0-4ac0-9a14-d23f6ef02f45 req-a50a2c1d-ccfc-43f5-aef4-9d84d039f4bd service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Received event network-vif-unplugged-6a705171-4b6c-45df-ac14-46862c313924 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:06:07.780649 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Instance destroyed successfully. Jun 03 01:06:07.781185 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lazy-loading 'resources' on Instance uuid 697c41c0-3674-4c57-b793-7ab8a4abe82a {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:07.835796 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:08.121864 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "f448afac-6687-4a4a-84ff-b4478c316986" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:08.122098 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:08.170000 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:08.170180 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] VM Started (Lifecycle Event) Jun 03 01:06:08.202095 np0000002000 nova-compute[98288]: DEBUG nova.compute.rpcapi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98288) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 03 01:06:08.213408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:08.214006 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:08.214161 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:08.286965 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-743073027',display_name='tempest-AttachSCSIVolumeTestJSON-server-743073027',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-attachscsivolumetestjson-server-743073027',id=5,image_ref='1f393b31-76b2-414c-aa54-aa84cfe3f2a5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkmvWN6Ogv3jl3xunvxsecfR2agWAUfDUKPp6EXqbASUB5k9Op1GZr/eJGHMglaTxwu+mjTpET+l0EaxHt0Tkk8/dkQcVkU3IB5HnDqtSWQIC3KqSQO7XYF2cUruwiXUg==',key_name='tempest-keypair-734539003',keypairs=,launch_index=0,launched_at=2026-06-03T01:05:10Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='c789ce874dc544078557d41878b032f2',ramdisk_id='',reservation_id='r-qmui8520',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1f393b31-76b2-414c-aa54-aa84cfe3f2a5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1913972656',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1913972656-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:05:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d3ca82994a746679bd54e387b6a0214',uuid=697c41c0-3674-4c57-b793-7ab8a4abe82a,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a705171-4b6c-45df-ac14-46862c313924", "address": "fa:16:3e:d9:ee:44", "network": {"id": "3bbe9fd2-9242-4876-a8e2-e7d15f27293f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890948811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c789ce874dc544078557d41878b032f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a705171-4b", "ovs_interfaceid": "6a705171-4b6c-45df-ac14-46862c313924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:06:08.289385 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Converting VIF {"id": "6a705171-4b6c-45df-ac14-46862c313924", "address": "fa:16:3e:d9:ee:44", "network": {"id": "3bbe9fd2-9242-4876-a8e2-e7d15f27293f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1890948811-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c789ce874dc544078557d41878b032f2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a705171-4b", "ovs_interfaceid": "6a705171-4b6c-45df-ac14-46862c313924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:08.290355 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=6a705171-4b6c-45df-ac14-46862c313924,network=Network(3bbe9fd2-9242-4876-a8e2-e7d15f27293f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a705171-4b') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:08.295096 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=6a705171-4b6c-45df-ac14-46862c313924,network=Network(3bbe9fd2-9242-4876-a8e2-e7d15f27293f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a705171-4b') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:06:08.295096 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:08.295096 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a705171-4b, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:08.295096 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:08.295096 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:08.295096 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No VIF found with MAC fa:16:3e:5e:4e:78, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:06:08.295631 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:08.296525 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Using config drive Jun 03 01:06:08.300289 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:08.301933 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:08.301933 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=862c5aff-f2d6-4c6f-b1ef-3e27d3f09c0b) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:08.301933 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:08.302555 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:08.306825 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:08.308369 np0000002000 nova-compute[98288]: INFO os_vif [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:ee:44,bridge_name='br-int',has_traffic_filtering=True,id=6a705171-4b6c-45df-ac14-46862c313924,network=Network(3bbe9fd2-9242-4876-a8e2-e7d15f27293f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a705171-4b') Jun 03 01:06:08.308680 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Deleting instance files /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a_del Jun 03 01:06:08.309600 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Deletion of /opt/stack/data/nova/instances/697c41c0-3674-4c57-b793-7ab8a4abe82a_del complete Jun 03 01:06:08.377315 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-073c0291-9114-4105-b21c-aafb1eb16ab5 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.638s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:08.536858 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0009964539999600674 future=) was cancelled during its delay period, skipping {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:08.536858 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:08.537028 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.099120911999989 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:08.537028 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.099057297000172 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:08.588344 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:08.624925 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lazy-loading 'flavor' on Instance uuid f448afac-6687-4a4a-84ff-b4478c316986 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:08.672319 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:08.675760 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:08.766149 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-61ae71b8-5f24-4ce5-9c72-9c5a88087707 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Unrescuing Jun 03 01:06:08.766149 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-61ae71b8-5f24-4ce5-9c72-9c5a88087707 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "refresh_cache-5fa25fea-9624-4611-8579-d6891f822679" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:08.766149 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-61ae71b8-5f24-4ce5-9c72-9c5a88087707 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquired lock "refresh_cache-5fa25fea-9624-4611-8579-d6891f822679" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:08.766149 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-61ae71b8-5f24-4ce5-9c72-9c5a88087707 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:06:08.782252 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:08.782503 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:08.782965 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:08.783116 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:08.783506 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] No waiting events found dispatching network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:08.783662 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received unexpected event network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd for instance with vm_state rescued and task_state unrescuing. Jun 03 01:06:08.783784 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event network-changed-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:08.783884 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Refreshing instance network info cache due to event network-changed-c4966a48-9680-4d94-b3d2-f1ffb52ae18f. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:08.784024 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] Acquiring lock "refresh_cache-fd0a3a08-1a8c-482c-836a-19ac700c473f" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:08.784129 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] Acquired lock "refresh_cache-fd0a3a08-1a8c-482c-836a-19ac700c473f" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:08.784232 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Refreshing network info cache for port c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:08.801451 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:08.814026 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Took 1.37 seconds to destroy the instance on the hypervisor. Jun 03 01:06:08.814626 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:06:08.814856 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:06:08.814948 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:06:08.815157 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:08.899253 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:08.966658 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Creating config drive at /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.config Jun 03 01:06:08.971772 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5zovw44q {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:09.015254 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5zovw44q" returned: 0 in 0.041s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:09.178197 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 03 01:06:09.178695 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999788865000028 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:09.224870 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:09.269465 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-61ae71b8-5f24-4ce5-9c72-9c5a88087707 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:09.286355 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:09.403174 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-93a7ea66-eb3d-4856-894e-344e864009b2 req-7ecdc341-9f4a-4bb7-839b-54d86dd614f7 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Received event network-vif-deleted-6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:09.403638 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-93a7ea66-eb3d-4856-894e-344e864009b2 req-7ecdc341-9f4a-4bb7-839b-54d86dd614f7 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Neutron deleted interface 6a705171-4b6c-45df-ac14-46862c313924; detaching it from the instance and deleting it from the info cache Jun 03 01:06:09.407591 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-93a7ea66-eb3d-4856-894e-344e864009b2 req-7ecdc341-9f4a-4bb7-839b-54d86dd614f7 service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Detach interface failed, port_id=6a705171-4b6c-45df-ac14-46862c313924, reason: Instance 697c41c0-3674-4c57-b793-7ab8a4abe82a could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:06:09.439949 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:09.440107 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquired lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:09.440276 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:06:09.454189 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:09.488159 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:09.568304 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:09.636930 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.515s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:09.656581 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:09.656732 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:09.835311 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:09.871861 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c026bad1-8e3a-44af-8e98-28370d5f5d95 req-1892a8d3-9f03-47d8-928d-238daf54552c service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Received event network-vif-unplugged-6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:09.871861 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c026bad1-8e3a-44af-8e98-28370d5f5d95 req-1892a8d3-9f03-47d8-928d-238daf54552c service nova] Acquiring lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:09.871861 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c026bad1-8e3a-44af-8e98-28370d5f5d95 req-1892a8d3-9f03-47d8-928d-238daf54552c service nova] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:09.871861 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c026bad1-8e3a-44af-8e98-28370d5f5d95 req-1892a8d3-9f03-47d8-928d-238daf54552c service nova] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:09.871861 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c026bad1-8e3a-44af-8e98-28370d5f5d95 req-1892a8d3-9f03-47d8-928d-238daf54552c service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] No waiting events found dispatching network-vif-unplugged-6a705171-4b6c-45df-ac14-46862c313924 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:09.871861 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c026bad1-8e3a-44af-8e98-28370d5f5d95 req-1892a8d3-9f03-47d8-928d-238daf54552c service nova] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Received event network-vif-unplugged-6a705171-4b6c-45df-ac14-46862c313924 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:06:09.942251 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:10.092211 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-61ae71b8-5f24-4ce5-9c72-9c5a88087707 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:10.097681 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:10.288030 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-61ae71b8-5f24-4ce5-9c72-9c5a88087707 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Updating instance_info_cache with network_info: [{"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:10.328459 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Updated VIF entry in instance network info cache for port c4966a48-9680-4d94-b3d2-f1ffb52ae18f. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:06:10.328459 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Updating instance_info_cache with network_info: [{"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:10.339879 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Took 1.52 seconds to deallocate network for instance. Jun 03 01:06:10.420420 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:10.420420 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] VM Started (Lifecycle Event) Jun 03 01:06:10.436022 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:10.586989 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updating instance_info_cache with network_info: [{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:10.741545 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "f448afac-6687-4a4a-84ff-b4478c316986" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:10.741630 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:10.742430 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Attaching volume 3eebcb34-c093-4aee-a218-870a08a435c0 to /dev/vdb Jun 03 01:06:10.756269 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:10.784277 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:10.791073 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-61ae71b8-5f24-4ce5-9c72-9c5a88087707 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Releasing lock "refresh_cache-5fa25fea-9624-4611-8579-d6891f822679" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:10.791653 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-61ae71b8-5f24-4ce5-9c72-9c5a88087707 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'flavor' on Instance uuid 5fa25fea-9624-4611-8579-d6891f822679 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:10.797595 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:06:10.819696 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:10.835066 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-794d9b3d-6bcf-4ffe-8b17-f8667a16b8d1 req-257e106c-5dd5-4ec6-8e20-fb225be8f12a service nova] Releasing lock "refresh_cache-fd0a3a08-1a8c-482c-836a-19ac700c473f" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:10.848268 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:10.849170 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:10.859547 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:06:10.859847 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:06:10.869214 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:06:10.870490 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feb8:822', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::fc16:3eff:fe5c:d4cc', 'fe80::34c3:b7ff:fe30:cb04', 'fe80::fc16:3eff:fe7f:c107', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fe29:1d7b', 'fe80::fc16:3eff:fe52:40dc', 'fe80::ec6a:1ff:fe54:5dbf', 'fe80::fc16:3eff:fee5:47da', 'fe80::fc16:3eff:fe5e:4e78'] Jun 03 01:06:10.870601 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:06:10.870705 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:06:10.870912 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:10.871115 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Updating existing volume attachment record: 9ccebd23-5961-46a3-8f50-df099f038583 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:06:10.925747 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:10.931126 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:10.931126 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] VM Paused (Lifecycle Event) Jun 03 01:06:11.089424 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Releasing lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:11.153956 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:06:11.155460 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:06:11.155460 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:06:11.155460 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:06:11.155460 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:06:11.155460 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:06:11.155460 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:06:11.155729 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:06:11.155729 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 03 01:06:11.155867 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:06:11.317947 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:11.325461 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:11.341283 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:11.432520 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:11.435842 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:11.443471 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:06:11.443471 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eebcb34-c093-4aee-a218-870a08a435c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:11.443471 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:11.443471 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:11.443471 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eebcb34-c093-4aee-a218-870a08a435c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:06:11.455146 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:11.457469 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:11.457469 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:11.458387 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:11.458387 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:11.458693 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.startup = automatic Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.scan = manual Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:11.473057 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.startup = automatic Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.scan = manual Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:11.479733 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:11.488599 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:11.494829 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:11.503183 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-90fa2884-1b7c-4fe3-809f-ae5b7414b1cb req-34f8f6aa-e1ac-466f-89e4-5b7d3392628d service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:11.503543 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-90fa2884-1b7c-4fe3-809f-ae5b7414b1cb req-34f8f6aa-e1ac-466f-89e4-5b7d3392628d service nova] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:11.503778 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-90fa2884-1b7c-4fe3-809f-ae5b7414b1cb req-34f8f6aa-e1ac-466f-89e4-5b7d3392628d service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:11.504000 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-90fa2884-1b7c-4fe3-809f-ae5b7414b1cb req-34f8f6aa-e1ac-466f-89e4-5b7d3392628d service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:11.504507 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-90fa2884-1b7c-4fe3-809f-ae5b7414b1cb req-34f8f6aa-e1ac-466f-89e4-5b7d3392628d service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Processing event network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:06:11.504507 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-90fa2884-1b7c-4fe3-809f-ae5b7414b1cb req-34f8f6aa-e1ac-466f-89e4-5b7d3392628d service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:11.504660 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-90fa2884-1b7c-4fe3-809f-ae5b7414b1cb req-34f8f6aa-e1ac-466f-89e4-5b7d3392628d service nova] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:11.504822 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-90fa2884-1b7c-4fe3-809f-ae5b7414b1cb req-34f8f6aa-e1ac-466f-89e4-5b7d3392628d service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:11.504953 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-90fa2884-1b7c-4fe3-809f-ae5b7414b1cb req-34f8f6aa-e1ac-466f-89e4-5b7d3392628d service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:11.505160 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-90fa2884-1b7c-4fe3-809f-ae5b7414b1cb req-34f8f6aa-e1ac-466f-89e4-5b7d3392628d service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] No waiting events found dispatching network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:11.505336 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-90fa2884-1b7c-4fe3-809f-ae5b7414b1cb req-34f8f6aa-e1ac-466f-89e4-5b7d3392628d service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received unexpected event network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e for instance with vm_state building and task_state spawning. Jun 03 01:06:11.506889 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:06:11.513864 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:11.514178 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:06:11.516908 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:11.516908 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:11.516908 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:11.516908 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:11.516908 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:11.516908 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:11.516908 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:11.517257 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:11.517399 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:11.517399 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:11.517399 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:11.517399 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:11.517399 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:11.517399 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:11.517399 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:11.521665 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:11.521665 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:11.521665 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:11.521665 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:11.521665 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:11.521665 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:11.521665 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:11.521833 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:11.521833 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:11.521833 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:11.521833 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:11.521833 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:11.521833 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:11.521833 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:11.522270 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.064s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:11.522426 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:11.523571 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:11.523742 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:11.524093 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] HCTL ('17', '0', '0', 0) found on session 17 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:11.524278 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:11.525828 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] HCTL ('18', '0', '0', 0) found on session 18 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:11.526289 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:11.528085 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Instance spawned successfully. Jun 03 01:06:11.530713 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:06:11.537304 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Searching for a device in session 17 and hctl ('17', '0', '0', 0) yield: sdm {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:11.537523 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3eebcb34-c093-4aee-a218-870a08a435c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:11.540019 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Searching for a device in session 18 and hctl ('18', '0', '0', 0) yield: sdl {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:11.540501 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eebcb34-c093-4aee-a218-870a08a435c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:11.557268 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:06:11.557619 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:06:11.598658 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:11.613861 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:06:11.640821 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:11.667530 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:11.670453 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-50dc56c5-95d8-403b-88b2-b70ec0d8a3ba req-5a4538e3-bac5-4dea-8f66-a3ca9d5c09ea service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:11.670815 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-50dc56c5-95d8-403b-88b2-b70ec0d8a3ba req-5a4538e3-bac5-4dea-8f66-a3ca9d5c09ea service nova] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:11.673131 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-50dc56c5-95d8-403b-88b2-b70ec0d8a3ba req-5a4538e3-bac5-4dea-8f66-a3ca9d5c09ea service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:11.673296 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-50dc56c5-95d8-403b-88b2-b70ec0d8a3ba req-5a4538e3-bac5-4dea-8f66-a3ca9d5c09ea service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:11.673682 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-50dc56c5-95d8-403b-88b2-b70ec0d8a3ba req-5a4538e3-bac5-4dea-8f66-a3ca9d5c09ea service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] No waiting events found dispatching network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:11.673850 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-50dc56c5-95d8-403b-88b2-b70ec0d8a3ba req-5a4538e3-bac5-4dea-8f66-a3ca9d5c09ea service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received unexpected event network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd for instance with vm_state rescued and task_state unrescuing. Jun 03 01:06:11.674717 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Instance destroyed successfully. Jun 03 01:06:11.675433 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-61ae71b8-5f24-4ce5-9c72-9c5a88087707 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'numa_topology' on Instance uuid 5fa25fea-9624-4611-8579-d6891f822679 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:11.687736 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:06:11.687939 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:06:11.705919 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:06:11.710878 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feb8:822', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::fc16:3eff:fe5c:d4cc', 'fe80::34c3:b7ff:fe30:cb04', 'fe80::fc16:3eff:fe7f:c107', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fe29:1d7b', 'fe80::fc16:3eff:fe52:40dc', 'fe80::ec6a:1ff:fe54:5dbf', 'fe80::fc16:3eff:fe5e:4e78'] Jun 03 01:06:11.710878 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:06:11.710878 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:06:11.710878 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:11.826626 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:11.938304 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:06:11.938782 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:11.938996 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] VM Resumed (Lifecycle Event) Jun 03 01:06:12.042760 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:12.042950 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:12.043336 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:12.043662 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:12.044007 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:12.044348 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:12.061891 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:06:12.178803 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-61ae71b8-5f24-4ce5-9c72-9c5a88087707 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<5fa25fea-9624-4611-8579-d6891f822679> lazy-loaded attributes: flavor,numa_topology {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:06:12.442086 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:12.444331 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:12.459095 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:06:12.552018 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Took 7.54 seconds to spawn the instance on the hypervisor. Jun 03 01:06:12.552152 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:12.568738 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.720s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:12.571815 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.903s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:12.572172 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:12.572334 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Auditing locally available compute resources for np0000002000 (node: np0000002000) {{(pid=98288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 03 01:06:12.602259 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:12.633203 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:12.639353 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:12.659572 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Deleted allocations for instance 697c41c0-3674-4c57-b793-7ab8a4abe82a Jun 03 01:06:12.709598 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:12.774196 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:12.778052 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:12.837795 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:12.863753 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Starting finish_migration {{(pid=98288) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}} Jun 03 01:06:12.864701 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Instance directory exists: not creating {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} Jun 03 01:06:12.864833 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Creating image(s) Jun 03 01:06:12.865531 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:12.940090 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.074s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:12.940659 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:06:12.942927 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:12.950954 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:06:12.955345 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999677402000088 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:13.021022 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:13.022172 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Cannot resize image /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:06:13.061269 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Took 15.60 seconds to build instance. Jun 03 01:06:13.083040 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:13.302408 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:13.445918 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Removed pending STOPPED event for 5fa25fea-9624-4611-8579-d6891f822679 due to new event Resumed> {{(pid=98288) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 03 01:06:13.446101 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:13.446288 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] VM Resumed (Lifecycle Event) Jun 03 01:06:13.448020 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-61ae71b8-5f24-4ce5-9c72-9c5a88087707 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:13.488548 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Found WWN 3300000008a7288bf for multipath device dm-9 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:06:13.489387 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.047s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:13.489387 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] <== connect_volume: return (2047ms) {'type': 'block', 'scsi_wwn': '3300000008a7288bf', 'path': '/dev/dm-9', 'multipath_id': '3300000008a7288bf'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:13.489387 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008a7288bf', 'path': '/dev/dm-9', 'multipath_id': '3300000008a7288bf'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:06:13.493121 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lazy-loading 'flavor' on Instance uuid f448afac-6687-4a4a-84ff-b4478c316986 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:13.525118 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Did not create local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} Jun 03 01:06:13.525542 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Ensure instance console log exists: /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:06:13.525617 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:13.525788 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:13.525909 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:13.528561 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Start _get_guest_xml network_info=[{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1936602961-network", "vif_mac": "fa:16:3e:ee:15:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'f92e551e-6d0e-4ebb-83fd-f7c242f857a6', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '1225d1ad-70c5-43e1-b8f0-927efb3ef6be', 'attached_at': '2026-06-03T01:06:12.000000', 'detached_at': '', 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'serial': '0782cb8d-527b-47ac-898d-a53b667d4af1'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:06:13.531531 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:06:13.532609 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-690499922', uuid='1225d1ad-70c5-43e1-b8f0-927efb3ef6be'), owner=OwnerMeta(userid='a95a67614fa2443596fde71d819153e7', username='tempest-ServerActionsTestOtherB-1369156437-project-member', projectid='64016d71af32442f8c9e0e2fc40a542b', projectname='tempest-ServerActionsTestOtherB-1369156437'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1936602961-network", "vif_mac": "fa:16:3e:ee:15:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448773.5322685) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:06:13.534014 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:06:13.534014 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:06:13.534450 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:06:13.534626 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:06:13.535424 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:06:13.535745 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:06:13.535935 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:06:13.536033 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:06:13.536143 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:06:13.536223 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:06:13.536317 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:06:13.536553 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:06:13.536666 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:06:13.536777 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:06:13.536876 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:06:13.537007 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:06:13.547173 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.config --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:13.567303 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.111s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:13.628370 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.config --force-share --output=json" returned: 0 in 0.081s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:13.628824 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "/opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:13.629066 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "/opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:13.629596 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "/opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:13.630242 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:06:13.630370 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:13.630541 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:13.630854 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:13.633865 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:06:13.645288 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:13.646088 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:13.646934 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:13.646934 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:13.647544 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:13.651593 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:13.661297 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:13.661297 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:13.668744 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-fafdf339-0fae-4590-affa-ad5d51febbd8 tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Lock "697c41c0-3674-4c57-b793-7ab8a4abe82a" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.737s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:13.672789 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:13.672789 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:13.676254 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1] added Jun 03 01:06:13.676254 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:13.676254 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:13.676254 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:13.676254 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:13.676254 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:13.676254 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:13.676560 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:13.676800 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:13.677085 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:13.693934 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1] added Jun 03 01:06:13.693934 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:13.693934 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:13.693934 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:13.693934 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:13.693934 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:13.693934 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:13.694074 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:13.694245 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0465(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:13.694405 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:13.729831 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:13.730084 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:13.730276 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:13.730428 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:13.730602 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] No waiting events found dispatching network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:13.730772 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received unexpected event network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd for instance with vm_state active and task_state None. Jun 03 01:06:13.730929 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:13.731080 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:13.731268 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:13.731367 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:13.732190 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] No waiting events found dispatching network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:13.732392 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received unexpected event network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd for instance with vm_state active and task_state None. Jun 03 01:06:13.732596 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:13.732777 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:13.732966 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:13.733138 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:13.733311 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] No waiting events found dispatching network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:13.733752 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-fe349c94-2fe5-4c5e-bb0f-e1358ca6c9f3 req-392b9f81-2a11-404c-ad79-d6e78235eb2f service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received unexpected event network-vif-plugged-c9849bf1-2517-4a9c-8033-605596ac9dfd for instance with vm_state active and task_state None. Jun 03 01:06:13.848327 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:13.953020 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:13.964508 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:13.964508 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:13.985674 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:13.996214 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Attempting to attach volume 3eebcb34-c093-4aee-a218-870a08a435c0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98288) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 03 01:06:13.997338 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] attach device xml: Jun 03 01:06:13.997338 np0000002000 nova-compute[98288]: Jun 03 01:06:13.997338 np0000002000 nova-compute[98288]: Jun 03 01:06:13.997338 np0000002000 nova-compute[98288]: Jun 03 01:06:13.997338 np0000002000 nova-compute[98288]: Jun 03 01:06:13.997338 np0000002000 nova-compute[98288]: 3eebcb34-c093-4aee-a218-870a08a435c0 Jun 03 01:06:13.997338 np0000002000 nova-compute[98288]: Jun 03 01:06:13.997338 np0000002000 nova-compute[98288]: Jun 03 01:06:13.997338 np0000002000 nova-compute[98288]: {{(pid=98288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 03 01:06:14.047242 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:14.052308 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:14.135584 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:14.136134 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:14.218982 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:14.223996 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} Jun 03 01:06:14.225348 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} Jun 03 01:06:14.229325 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:14.329103 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:14.329103 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:14.423062 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:14.425935 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} Jun 03 01:06:14.431963 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:14.493824 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:14.494092 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] VM Started (Lifecycle Event) Jun 03 01:06:14.542584 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:14.543102 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:14.570480 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e49262b8-4e12-42f4-8e3e-c7bc1e18a463 req-55b142db-de15-413c-8361-4088add9e122 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-changed-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:14.573274 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e49262b8-4e12-42f4-8e3e-c7bc1e18a463 req-55b142db-de15-413c-8361-4088add9e122 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Refreshing instance network info cache due to event network-changed-32c927ec-8321-4de0-9cd5-36aaf8f01e7e. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:14.574481 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e49262b8-4e12-42f4-8e3e-c7bc1e18a463 req-55b142db-de15-413c-8361-4088add9e122 service nova] Acquiring lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:14.574481 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e49262b8-4e12-42f4-8e3e-c7bc1e18a463 req-55b142db-de15-413c-8361-4088add9e122 service nova] Acquired lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:14.574481 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-e49262b8-4e12-42f4-8e3e-c7bc1e18a463 req-55b142db-de15-413c-8361-4088add9e122 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Refreshing network info cache for port 32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:14.639921 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:14.644800 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:14.679503 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:14.694990 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:14.698250 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:14.711200 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:14.717263 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:14.730671 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:14.734372 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:14.734868 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:14.750513 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.750513 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.750513 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.750513 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.750513 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.750513 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.750513 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:14.752520 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.752520 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.752520 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.752520 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.752520 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.752520 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.752520 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:14.753517 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.753517 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.753517 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.753517 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.753517 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.753517 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.753517 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:14.753753 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.753753 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.753753 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.753753 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.753753 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.753753 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.753753 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:14.798614 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.40.100,3260] Jun 03 01:06:14.798614 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.40.100,3260] successful. Jun 03 01:06:14.798614 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:14.810888 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:14.811011 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.50.100,3260] Jun 03 01:06:14.811011 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.50.100,3260] successful. Jun 03 01:06:14.811011 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:14.818909 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:14.819674 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} Jun 03 01:06:14.823393 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:14.840368 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.840368 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.840368 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.840368 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.840368 np0000002000 nova-compute[98288]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:14.840368 np0000002000 nova-compute[98288]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:14.840368 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.840368 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.840368 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:14.840860 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.840860 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.840860 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.840860 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.840860 np0000002000 nova-compute[98288]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:14.840860 np0000002000 nova-compute[98288]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:14.840860 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.840860 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.840860 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:14.841895 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:14.842507 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:14.844547 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:14.848460 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] HCTL ('11', '-', '-', 0) found on session 19 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:14.848460 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:14.860131 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.860131 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.860131 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.860131 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.860131 np0000002000 nova-compute[98288]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:14.860131 np0000002000 nova-compute[98288]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:14.860131 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.860131 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.860131 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:14.860476 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.860476 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:14.860476 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.860476 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:14.860476 np0000002000 nova-compute[98288]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:14.860476 np0000002000 nova-compute[98288]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:14.860476 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.860476 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:14.860476 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:14.860712 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:14.860995 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:14.866613 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] HCTL ('12', '-', '-', 0) found on session 20 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:14.866613 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:14.869904 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Searching for a device in session 19 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:14.869904 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:14.878101 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Searching for a device in session 20 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:14.879648 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:14.943698 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:14.943698 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:15.003220 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:15.006198 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:15.039097 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:15.042905 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:15.080989 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-e49262b8-4e12-42f4-8e3e-c7bc1e18a463 req-55b142db-de15-413c-8361-4088add9e122 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:15.123535 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue --force-share --output=json" returned: 0 in 0.081s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:15.126105 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:15.211035 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue --force-share --output=json" returned: 0 in 0.085s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:15.214019 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:15.310314 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:15.310883 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:15.391603 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:15.394065 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:06:15.395262 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:15.425349 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "env LANG=C uptime" returned: 0 in 0.030s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:15.425660 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Hypervisor/Node resource view: name=np0000002000 free_ram=12726MB free_disk=74.41974258422852GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 03 01:06:15.425803 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:15.426004 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:15.527560 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-e49262b8-4e12-42f4-8e3e-c7bc1e18a463 req-55b142db-de15-413c-8361-4088add9e122 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:15.636637 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005052849999174214 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:15.637622 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:15.637826 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:15.638000 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=5.998259681000036 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:15.638243 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] VM Stopped (Lifecycle Event) Jun 03 01:06:15.638852 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=5.997439645999975 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:15.667909 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-e49262b8-4e12-42f4-8e3e-c7bc1e18a463 req-55b142db-de15-413c-8361-4088add9e122 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Updated VIF entry in instance network info cache for port 32c927ec-8321-4de0-9cd5-36aaf8f01e7e. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:06:15.668306 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-e49262b8-4e12-42f4-8e3e-c7bc1e18a463 req-55b142db-de15-413c-8361-4088add9e122 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Updating instance_info_cache with network_info: [{"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:15.671088 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:06:15.681009 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:15.681140 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:15.681299 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:15.681472 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] No VIF found with MAC fa:16:3e:5c:d4:cc, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:06:16.142468 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 9057f85b-8fb3-4f6b-9085-a9f8cc4c2bc1] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:16.170926 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e49262b8-4e12-42f4-8e3e-c7bc1e18a463 req-55b142db-de15-413c-8361-4088add9e122 service nova] Releasing lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:16.407403 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "71626a81-876a-40b9-ae4f-a57455bf345b" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:16.407880 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "71626a81-876a-40b9-ae4f-a57455bf345b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:16.442061 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Applying migration context for instance 1225d1ad-70c5-43e1-b8f0-927efb3ef6be as it has an incoming, in-progress migration 8708136b-03fb-48d0-97ba-1773f515e332. Migration status is post-migrating {{(pid=98288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}} Jun 03 01:06:16.444269 np0000002000 nova-compute[98288]: INFO nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updating resource usage from migration 8708136b-03fb-48d0-97ba-1773f515e332 Jun 03 01:06:16.501982 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:06:16.502102 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance f448afac-6687-4a4a-84ff-b4478c316986 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:06:16.502234 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:06:16.502362 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance cbb3ba9a-f26f-40c4-ac5b-00470740fd96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:06:16.502467 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 2bdcee06-76d6-431e-bef1-84b1acf1ccca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:06:16.502609 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 5fa25fea-9624-4611-8579-d6891f822679 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:06:16.502693 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance fd0a3a08-1a8c-482c-836a-19ac700c473f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:06:16.502827 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Migration 8708136b-03fb-48d0-97ba-1773f515e332 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}} Jun 03 01:06:16.502942 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 1225d1ad-70c5-43e1-b8f0-927efb3ef6be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:06:16.503056 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 0584c6a8-64fc-4891-ba12-b8ede4275b95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:06:16.690435 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Found WWN 3300000004792dc3e for multipath device dm-2 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:06:16.690890 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.060s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:16.694894 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] <== connect_volume: return (3060ms) {'type': 'block', 'scsi_wwn': '3300000004792dc3e', 'path': '/dev/dm-2', 'multipath_id': '3300000004792dc3e'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:16.695179 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004792dc3e', 'path': '/dev/dm-2', 'multipath_id': '3300000004792dc3e'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:06:16.912494 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:06:17.008485 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 71626a81-876a-40b9-ae4f-a57455bf345b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}} Jun 03 01:06:17.008485 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 03 01:06:17.008485 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Final resource view: name=np0000002000 phys_ram=24030MB used_ram=2496MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:06:15 up 29 min, 2 users, load average: 8.39, 4.21, 1.98\n', 'num_instances': '9', 'num_vm_active': '8', 'num_task_None': '8', 'num_os_type_None': '9', 'num_proj_e3b5c165c8b142b6af1c20eeac918eb0': '2', 'io_workload': '0', 'num_task_resize_finish': '1', 'num_proj_64016d71af32442f8c9e0e2fc40a542b': '1', 'num_proj_497a75226ead41d0b5de0b5e17c7c55c': '2', 'num_proj_8d71b7749b9b414ea4fb3ad943aebf49': '3', 'num_vm_rescued': '1', 'num_proj_ae2da6faf29d4db18ccfc9a42a93ab7d': '1'} {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 03 01:06:17.208014 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-690499922',display_name='tempest-ServerActionsTestOtherB-server-690499922',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002000',hostname='tempest-serveractionstestotherb-server-690499922',id=3,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+EmDDwoR2OvmMWSLRL3pD12IuhLKXYlFCyFD0S6tz1U811/Ppz6LfRqvK84OL/tJp7AFM3OOYK27W8pAe9Ufj1wNI9CICCs+j8JCdUBCkwgtBDQJU6o6T6RKxEkHfeyw==',key_name='tempest-keypair-122608129',keypairs=,launch_index=0,launched_at=2026-06-03T01:05:00Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002000',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='64016d71af32442f8c9e0e2fc40a542b',ramdisk_id='',reservation_id='r-mvqoecge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1369156437',owner_user_name='tempest-ServerActionsTestOtherB-1369156437-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95a67614fa2443596fde71d819153e7',uuid=1225d1ad-70c5-43e1-b8f0-927efb3ef6be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1936602961-network", "vif_mac": "fa:16:3e:ee:15:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:17.208434 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converting VIF {"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1936602961-network", "vif_mac": "fa:16:3e:ee:15:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:17.208994 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] End _get_guest_xml xml= Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: instance-00000003 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 262144 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: tempest-ServerActionsTestOtherB-server-690499922 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 2026-06-03 01:06:13 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 256 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: True Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: bare Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: ide Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: pc Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: tempest-ServerActionsTestOtherB-1369156437-project-member Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: tempest-ServerActionsTestOtherB-1369156437 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: hvm Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 128 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: 0782cb8d-527b-47ac-898d-a53b667d4af1 Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: Jun 03 01:06:17.212509 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:06:17.215603 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-690499922',display_name='tempest-ServerActionsTestOtherB-server-690499922',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002000',hostname='tempest-serveractionstestotherb-server-690499922',id=3,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+EmDDwoR2OvmMWSLRL3pD12IuhLKXYlFCyFD0S6tz1U811/Ppz6LfRqvK84OL/tJp7AFM3OOYK27W8pAe9Ufj1wNI9CICCs+j8JCdUBCkwgtBDQJU6o6T6RKxEkHfeyw==',key_name='tempest-keypair-122608129',keypairs=,launch_index=0,launched_at=2026-06-03T01:05:00Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002000',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='64016d71af32442f8c9e0e2fc40a542b',ramdisk_id='',reservation_id='r-mvqoecge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1369156437',owner_user_name='tempest-ServerActionsTestOtherB-1369156437-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95a67614fa2443596fde71d819153e7',uuid=1225d1ad-70c5-43e1-b8f0-927efb3ef6be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1936602961-network", "vif_mac": "fa:16:3e:ee:15:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:17.215603 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converting VIF {"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1936602961-network", "vif_mac": "fa:16:3e:ee:15:36"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:17.215814 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:17.216075 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:17.216575 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:17.216844 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:17.217178 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:17.218062 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:17.218270 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9131e6e7-d4af-574b-b318-b6addccb32fa', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:17.218911 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:17.219518 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:17.220977 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:17.223885 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:17.224042 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9055a094-dc, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:17.224343 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9055a094-dc, col_values=(('qos', UUID('e43616a7-6c66-420d-a54f-3ca305001402')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:17.224508 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9055a094-dc, col_values=(('external_ids', {'iface-id': '9055a094-dc81-45da-9637-48b820c58772', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:15:36', 'vm-uuid': '1225d1ad-70c5-43e1-b8f0-927efb3ef6be'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:17.225289 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:17.226689 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:17.231341 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:17.232088 np0000002000 nova-compute[98288]: INFO os_vif [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') Jun 03 01:06:17.261943 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-03019bdb-b8c5-44ab-8a3b-4d0499acd3f6 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.520s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:17.480188 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:17.577481 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:17.577481 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:17.614740 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:06:17.614954 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:06:17.840726 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:18.078602 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:06:18.118153 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:06:18.216386 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "f448afac-6687-4a4a-84ff-b4478c316986" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:18.216811 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:18.329736 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:18.626842 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Compute_service record updated for np0000002000:np0000002000 {{(pid=98288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 03 01:06:18.626842 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.201s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:18.628135 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 41.85 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:06:18.630920 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.151s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:18.636066 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:06:18.636134 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Claim successful on node np0000002000 Jun 03 01:06:18.648366 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:18.718874 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Detaching volume 3eebcb34-c093-4aee-a218-870a08a435c0 Jun 03 01:06:18.753740 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:18.753949 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:18.754110 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:18.754251 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] No VIF found with MAC fa:16:3e:ee:15:36, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:06:18.754920 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Using config drive Jun 03 01:06:18.766528 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Attempting to driver detach volume 3eebcb34-c093-4aee-a218-870a08a435c0 from mountpoint /dev/vdb Jun 03 01:06:18.773610 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Found disk vdb by alias ua-3eebcb34-c093-4aee-a218-870a08a435c0 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:06:18.774547 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Found disk vdb by alias ua-3eebcb34-c093-4aee-a218-870a08a435c0 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:06:18.774665 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Attempting to detach device vdb from instance f448afac-6687-4a4a-84ff-b4478c316986 from the persistent domain config. {{(pid=98288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 03 01:06:18.774868 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] detach device xml: Jun 03 01:06:18.774868 np0000002000 nova-compute[98288]: Jun 03 01:06:18.774868 np0000002000 nova-compute[98288]: Jun 03 01:06:18.774868 np0000002000 nova-compute[98288]: Jun 03 01:06:18.774868 np0000002000 nova-compute[98288]: Jun 03 01:06:18.774868 np0000002000 nova-compute[98288]: 3eebcb34-c093-4aee-a218-870a08a435c0 Jun 03 01:06:18.774868 np0000002000 nova-compute[98288]: Jun 03 01:06:18.774868 np0000002000 nova-compute[98288]:
Jun 03 01:06:18.774868 np0000002000 nova-compute[98288]: Jun 03 01:06:18.774868 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:06:18.780570 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Successfully detached device vdb from instance f448afac-6687-4a4a-84ff-b4478c316986 from the persistent domain config. Jun 03 01:06:18.780685 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] (1/8): Attempting to detach device vdb with device alias ua-3eebcb34-c093-4aee-a218-870a08a435c0 from instance f448afac-6687-4a4a-84ff-b4478c316986 from the live domain config. {{(pid=98288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 03 01:06:18.780921 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] detach device xml: Jun 03 01:06:18.780921 np0000002000 nova-compute[98288]: Jun 03 01:06:18.780921 np0000002000 nova-compute[98288]: Jun 03 01:06:18.780921 np0000002000 nova-compute[98288]: Jun 03 01:06:18.780921 np0000002000 nova-compute[98288]: Jun 03 01:06:18.780921 np0000002000 nova-compute[98288]: 3eebcb34-c093-4aee-a218-870a08a435c0 Jun 03 01:06:18.780921 np0000002000 nova-compute[98288]: Jun 03 01:06:18.780921 np0000002000 nova-compute[98288]:
Jun 03 01:06:18.780921 np0000002000 nova-compute[98288]: Jun 03 01:06:18.780921 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:06:19.178539 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:19.210722 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:19.211015 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:19.274342 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Received event ua-3eebcb34-c093-4aee-a218-870a08a435c0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98288) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 03 01:06:19.283273 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3eebcb34-c093-4aee-a218-870a08a435c0 for instance f448afac-6687-4a4a-84ff-b4478c316986 {{(pid=98288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 03 01:06:19.288458 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Successfully detached device vdb from instance f448afac-6687-4a4a-84ff-b4478c316986 from the live domain config. Jun 03 01:06:19.422969 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:19.490034 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-0a3353c9-c449-42dc-8bcd-ae7061c91bb4 req-e7e290c9-7308-4ce3-8aab-006d94e40488 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:19.493822 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-0a3353c9-c449-42dc-8bcd-ae7061c91bb4 req-e7e290c9-7308-4ce3-8aab-006d94e40488 service nova] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:19.494047 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-0a3353c9-c449-42dc-8bcd-ae7061c91bb4 req-e7e290c9-7308-4ce3-8aab-006d94e40488 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:19.494183 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-0a3353c9-c449-42dc-8bcd-ae7061c91bb4 req-e7e290c9-7308-4ce3-8aab-006d94e40488 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:19.494346 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-0a3353c9-c449-42dc-8bcd-ae7061c91bb4 req-e7e290c9-7308-4ce3-8aab-006d94e40488 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] No waiting events found dispatching network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:19.494516 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-0a3353c9-c449-42dc-8bcd-ae7061c91bb4 req-e7e290c9-7308-4ce3-8aab-006d94e40488 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received unexpected event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 for instance with vm_state active and task_state resize_finish. Jun 03 01:06:19.607365 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:19.612383 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:19.615563 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:19.616516 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:19.635090 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:19.910416 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Detected multiple connections on this host for volume: 3eebcb34-c093-4aee-a218-870a08a435c0, skipping target disconnect. Jun 03 01:06:20.204855 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Removed pending STOPPED event for 1225d1ad-70c5-43e1-b8f0-927efb3ef6be due to new event Resumed> {{(pid=98288) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 03 01:06:20.204855 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:20.204855 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] VM Resumed (Lifecycle Event) Jun 03 01:06:20.205036 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Instance event wait completed in 0 seconds for {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:06:20.207102 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Instance running successfully. Jun 03 01:06:20.207861 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Failed to set time: agent not configured {{(pid=98288) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jun 03 01:06:20.208020 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-63d9f4bf-ea08-4195-8eb5-667c6dd90883 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] finish_migration finished successfully. {{(pid=98288) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}} Jun 03 01:06:20.297250 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:20.326110 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:06:20.326270 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:06:20.488799 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lazy-loading 'flavor' on Instance uuid f448afac-6687-4a4a-84ff-b4478c316986 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:20.707797 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:20.710192 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:20.829021 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:06:21.213506 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 03 01:06:21.213506 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:21.213506 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] VM Started (Lifecycle Event) Jun 03 01:06:21.334971 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.704s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:21.335541 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:06:21.338697 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.690s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:21.341839 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:06:21.341915 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Claim successful on node np0000002000 Jun 03 01:06:21.497318 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-97bb2452-981c-4b15-9d0d-a2f735acaee1 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.281s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:21.579280 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fb3f5a04-a2fa-4e94-b9cd-63a8e9ba969c req-c5151c0a-55b6-4c0b-bfb8-af1a6baf87e9 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:21.579993 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fb3f5a04-a2fa-4e94-b9cd-63a8e9ba969c req-c5151c0a-55b6-4c0b-bfb8-af1a6baf87e9 service nova] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:21.580174 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fb3f5a04-a2fa-4e94-b9cd-63a8e9ba969c req-c5151c0a-55b6-4c0b-bfb8-af1a6baf87e9 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:21.580288 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fb3f5a04-a2fa-4e94-b9cd-63a8e9ba969c req-c5151c0a-55b6-4c0b-bfb8-af1a6baf87e9 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:21.580433 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fb3f5a04-a2fa-4e94-b9cd-63a8e9ba969c req-c5151c0a-55b6-4c0b-bfb8-af1a6baf87e9 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] No waiting events found dispatching network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:21.580585 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-fb3f5a04-a2fa-4e94-b9cd-63a8e9ba969c req-c5151c0a-55b6-4c0b-bfb8-af1a6baf87e9 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received unexpected event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 for instance with vm_state resized and task_state None. Jun 03 01:06:21.636868 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005166159999134834 future=) was cancelled during its delay period, skipping {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:21.636999 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:21.636999 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.5414688739999747 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:21.637088 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=2.54138098500016 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:21.718630 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:21.722742 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:21.841856 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:06:21.842509 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:06:21.842509 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:21.843186 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:21.930307 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a5f52b75bd44cd880fcd26870d24190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b5c165c8b142b6af1c20eeac918eb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:06:22.227010 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:22.344756 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:06:22.361598 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Successfully created port: 08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:06:22.632670 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:22.632857 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:22.733424 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:22.842227 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:22.851157 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:06:22.922307 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:22.922307 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:22.922307 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:22.936784 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Successfully updated port: 08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:06:23.014008 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:06:23.014239 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:06:23.019910 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Port 9055a094-dc81-45da-9637-48b820c58772 binding to destination host np0000002000 is already ACTIVE {{(pid=98288) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 03 01:06:23.019910 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:23.020593 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquired lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:23.020593 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:06:23.137267 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Detaching volume 3eebcb34-c093-4aee-a218-870a08a435c0 Jun 03 01:06:23.183640 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Attempting to driver detach volume 3eebcb34-c093-4aee-a218-870a08a435c0 from mountpoint /dev/vdb Jun 03 01:06:23.194044 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Found disk vdb by alias ua-3eebcb34-c093-4aee-a218-870a08a435c0 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:06:23.199468 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Found disk vdb by alias ua-3eebcb34-c093-4aee-a218-870a08a435c0 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:06:23.199468 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Attempting to detach device vdb from instance 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 from the persistent domain config. {{(pid=98288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 03 01:06:23.199468 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] detach device xml: Jun 03 01:06:23.199468 np0000002000 nova-compute[98288]: Jun 03 01:06:23.199468 np0000002000 nova-compute[98288]: Jun 03 01:06:23.199468 np0000002000 nova-compute[98288]: Jun 03 01:06:23.199468 np0000002000 nova-compute[98288]: Jun 03 01:06:23.199468 np0000002000 nova-compute[98288]: 3eebcb34-c093-4aee-a218-870a08a435c0 Jun 03 01:06:23.199468 np0000002000 nova-compute[98288]: Jun 03 01:06:23.199468 np0000002000 nova-compute[98288]:
Jun 03 01:06:23.199468 np0000002000 nova-compute[98288]: Jun 03 01:06:23.199468 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:06:23.204058 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Successfully detached device vdb from instance 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 from the persistent domain config. Jun 03 01:06:23.204058 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] (1/8): Attempting to detach device vdb with device alias ua-3eebcb34-c093-4aee-a218-870a08a435c0 from instance 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 from the live domain config. {{(pid=98288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 03 01:06:23.204058 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] detach device xml: Jun 03 01:06:23.204058 np0000002000 nova-compute[98288]: Jun 03 01:06:23.204058 np0000002000 nova-compute[98288]: Jun 03 01:06:23.204058 np0000002000 nova-compute[98288]: Jun 03 01:06:23.204058 np0000002000 nova-compute[98288]: Jun 03 01:06:23.204058 np0000002000 nova-compute[98288]: 3eebcb34-c093-4aee-a218-870a08a435c0 Jun 03 01:06:23.204058 np0000002000 nova-compute[98288]: Jun 03 01:06:23.204058 np0000002000 nova-compute[98288]:
Jun 03 01:06:23.204058 np0000002000 nova-compute[98288]: Jun 03 01:06:23.204058 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:06:23.438749 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "refresh_cache-71626a81-876a-40b9-ae4f-a57455bf345b" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:23.439203 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquired lock "refresh_cache-71626a81-876a-40b9-ae4f-a57455bf345b" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:23.439203 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:06:23.517724 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:06:23.522923 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:23.634545 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-646823dc-8f27-4860-88b5-0dad64dde4d2 req-8542e467-c5b1-48c3-a659-fa5c4f31f2ef service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Received event network-changed-08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:23.634659 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-646823dc-8f27-4860-88b5-0dad64dde4d2 req-8542e467-c5b1-48c3-a659-fa5c4f31f2ef service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Refreshing instance network info cache due to event network-changed-08eb504a-2b3a-4306-bca5-2cd861bcf959. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:23.634771 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-646823dc-8f27-4860-88b5-0dad64dde4d2 req-8542e467-c5b1-48c3-a659-fa5c4f31f2ef service nova] Acquiring lock "refresh_cache-71626a81-876a-40b9-ae4f-a57455bf345b" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:23.868727 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:06:23.871753 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:06:23.871993 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Creating image(s) Jun 03 01:06:23.872507 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "/opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:23.875057 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "/opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:23.875704 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "/opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:23.877382 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:23.883040 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:23.884040 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:23.909140 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:23.963243 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.079s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:23.963458 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:23.963937 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:23.964530 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:23.967855 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:23.968465 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:24.028581 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.689s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:24.028581 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:06:24.039855 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:06:24.064325 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.096s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:24.066406 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:24.099356 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updating instance_info_cache with network_info: [{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:24.137521 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk 1073741824" returned: 0 in 0.071s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:24.138330 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.174s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:24.138330 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:24.179179 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006456510000134585 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:24.179322 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:24.182295 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.772690214000022 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:24.182510 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=3.7725056180001957 future=) was cancelled while queued, skipping {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:24.182604 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:24.185161 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:24.185161 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] VM Stopped (Lifecycle Event) Jun 03 01:06:24.224350 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.086s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:24.224760 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:06:24.224985 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:24.255162 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:24.318611 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:24.322372 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Cannot resize image /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:06:24.322372 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:06:24.322372 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Ensure instance console log exists: /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:06:24.322372 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:24.322372 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:24.322372 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:24.439619 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Updating instance_info_cache with network_info: [{"id": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "address": "fa:16:3e:6f:53:ec", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08eb504a-2b", "ovs_interfaceid": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:24.538763 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:06:24.539141 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:06:24.539260 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:24.539527 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:24.604163 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Releasing lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:24.687798 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8ade4f46-051e-49f9-ba94-bca966df05a8 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: 697c41c0-3674-4c57-b793-7ab8a4abe82a] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:24.755016 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34ccf4f2b4d0406e9688c5b64264c051', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0b405f69b049b390b824dd46c5fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:06:24.942690 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Releasing lock "refresh_cache-71626a81-876a-40b9-ae4f-a57455bf345b" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:24.942690 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Instance network_info: |[{"id": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "address": "fa:16:3e:6f:53:ec", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08eb504a-2b", "ovs_interfaceid": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:06:24.942690 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-646823dc-8f27-4860-88b5-0dad64dde4d2 req-8542e467-c5b1-48c3-a659-fa5c4f31f2ef service nova] Acquired lock "refresh_cache-71626a81-876a-40b9-ae4f-a57455bf345b" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:24.942690 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-646823dc-8f27-4860-88b5-0dad64dde4d2 req-8542e467-c5b1-48c3-a659-fa5c4f31f2ef service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Refreshing network info cache for port 08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:24.946884 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Start _get_guest_xml network_info=[{"id": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "address": "fa:16:3e:6f:53:ec", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08eb504a-2b", "ovs_interfaceid": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:06:24.955005 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:06:24.955005 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1880386759', uuid='71626a81-876a-40b9-ae4f-a57455bf345b'), owner=OwnerMeta(userid='6a5f52b75bd44cd880fcd26870d24190', username='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member', projectid='e3b5c165c8b142b6af1c20eeac918eb0', projectname='tempest-ServerBootFromVolumeStableRescueTest-1020364370'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "address": "fa:16:3e:6f:53:ec", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08eb504a-2b", "ovs_interfaceid": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448784.9541998) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:06:24.958249 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:06:24.959425 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:06:24.963611 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:06:24.963611 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:06:24.963611 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:06:24.963611 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:06:24.963611 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:06:24.963611 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:06:24.963611 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:06:24.963611 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:06:24.963611 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:06:24.964874 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:06:24.966010 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:06:24.966299 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:06:24.966598 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:06:24.966889 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:06:24.978991 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1880386759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-1880386759',id=14,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-pz33immf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:23Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=71626a81-876a-40b9-ae4f-a57455bf345b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "address": "fa:16:3e:6f:53:ec", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08eb504a-2b", "ovs_interfaceid": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:24.979530 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "address": "fa:16:3e:6f:53:ec", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08eb504a-2b", "ovs_interfaceid": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:24.980391 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:53:ec,bridge_name='br-int',has_traffic_filtering=True,id=08eb504a-2b3a-4306-bca5-2cd861bcf959,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08eb504a-2b') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:24.981480 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'pci_devices' on Instance uuid 71626a81-876a-40b9-ae4f-a57455bf345b {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:25.044663 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:06:25.109161 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Creating tmpfile /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/tmpjprrypbj to verify with other compute node that the instance is on the same shared storage. {{(pid=98288) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}} Jun 03 01:06:25.109407 np0000002000 nova-compute[98288]: DEBUG nova.compute.rpcapi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98288) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 03 01:06:25.256554 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Successfully created port: a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:06:25.306220 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Received event ua-3eebcb34-c093-4aee-a218-870a08a435c0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98288) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 03 01:06:25.307722 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3eebcb34-c093-4aee-a218-870a08a435c0 for instance 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 {{(pid=98288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 03 01:06:25.312591 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Successfully detached device vdb from instance 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 from the live domain config. Jun 03 01:06:25.349592 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:06:25.349923 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eebcb34-c093-4aee-a218-870a08a435c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:25.350998 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:25.351755 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:25.354317 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3eebcb34-c093-4aee-a218-870a08a435c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:06:25.354574 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:06:25.382582 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:25.382582 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:25.382582 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:25.382582 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:25.382582 np0000002000 nova-compute[98288]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:25.382582 np0000002000 nova-compute[98288]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:25.382582 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:25.382582 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:25.382582 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:25.382840 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:25.382840 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:25.382840 np0000002000 nova-compute[98288]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:25.382840 np0000002000 nova-compute[98288]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0 (non-flash) Jun 03 01:06:25.382840 np0000002000 nova-compute[98288]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:25.382840 np0000002000 nova-compute[98288]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:25.382840 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:25.382840 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:25.382840 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:25.382978 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:06:25.382978 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', '18')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:25.383942 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0', '17')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:25.386918 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Resulting device map defaultdict(. at 0x73e7b80f5620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0'): ({'sdm'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:06:25.386918 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Removing multipathed devices sdm, sdl {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:06:25.386918 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Flush multipath device 3300000008a7288bf {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:06:25.420048 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:06:25.446235 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-646823dc-8f27-4860-88b5-0dad64dde4d2 req-8542e467-c5b1-48c3-a659-fa5c4f31f2ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:25.461102 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] End _get_guest_xml xml= Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 71626a81-876a-40b9-ae4f-a57455bf345b Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: instance-0000000e Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 196608 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-server-1880386759 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 2026-06-03 01:06:24 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 192 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: True Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: bare Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-1020364370 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 71626a81-876a-40b9-ae4f-a57455bf345b Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 71626a81-876a-40b9-ae4f-a57455bf345b Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: hvm Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 128 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: Jun 03 01:06:25.484030 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:06:25.485909 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Preparing to wait for external event network-vif-plugged-08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:25.485909 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:25.485909 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:25.485909 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:25.485909 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1880386759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-1880386759',id=14,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-pz33immf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:23Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=71626a81-876a-40b9-ae4f-a57455bf345b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "address": "fa:16:3e:6f:53:ec", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08eb504a-2b", "ovs_interfaceid": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:25.486141 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "address": "fa:16:3e:6f:53:ec", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08eb504a-2b", "ovs_interfaceid": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:25.486690 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:53:ec,bridge_name='br-int',has_traffic_filtering=True,id=08eb504a-2b3a-4306-bca5-2cd861bcf959,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08eb504a-2b') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:25.486690 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:53:ec,bridge_name='br-int',has_traffic_filtering=True,id=08eb504a-2b3a-4306-bca5-2cd861bcf959,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08eb504a-2b') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:25.487337 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:25.487397 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:25.487756 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:25.489075 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:25.489372 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '419acdea-ec45-50d0-815e-76831d5b97a1', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:25.490313 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:25.491264 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:25.495503 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:25.495730 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08eb504a-2b, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:25.496158 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08eb504a-2b, col_values=(('qos', UUID('30791a9f-8a58-45f2-84d1-099a49f45b9d')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:25.497129 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08eb504a-2b, col_values=(('external_ids', {'iface-id': '08eb504a-2b3a-4306-bca5-2cd861bcf959', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:53:ec', 'vm-uuid': '71626a81-876a-40b9-ae4f-a57455bf345b'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:25.500311 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:25.505568 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:25.507781 np0000002000 nova-compute[98288]: INFO os_vif [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:53:ec,bridge_name='br-int',has_traffic_filtering=True,id=08eb504a-2b3a-4306-bca5-2cd861bcf959,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08eb504a-2b') Jun 03 01:06:25.519323 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:06:25.519546 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:06:25.520612 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:06:25.532881 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:06:25.533117 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:06:25.544643 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:25.584329 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0, portal: 192.168.40.100,3260] Jun 03 01:06:25.584329 np0000002000 nova-compute[98288]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0, portal: 192.168.40.100,3260] successful. Jun 03 01:06:25.584329 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:25.603375 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:25.618322 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:25.655345 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:25.657599 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:25.668375 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0, portal: 192.168.50.100,3260] Jun 03 01:06:25.668375 np0000002000 nova-compute[98288]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-3eebcb34-c093-4aee-a218-870a08a435c0, portal: 192.168.50.100,3260] successful. Jun 03 01:06:25.668375 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:25.681040 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:25.683783 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:25.687166 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:25.687867 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:25.687867 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] <== disconnect_volume: return (337ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:25.688024 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:06:25.707993 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:25.718288 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:25.812955 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Successfully created port: f898b240-5ec0-4735-90c6-f8aa562b0cac {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:06:25.849175 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-646823dc-8f27-4860-88b5-0dad64dde4d2 req-8542e467-c5b1-48c3-a659-fa5c4f31f2ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:25.856853 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-66b61af8-f914-4c15-8a63-cf9473bdba22 req-8774517c-6b2f-4c99-95f8-04fc43867341 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:25.857368 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-66b61af8-f914-4c15-8a63-cf9473bdba22 req-8774517c-6b2f-4c99-95f8-04fc43867341 service nova] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:25.857604 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-66b61af8-f914-4c15-8a63-cf9473bdba22 req-8774517c-6b2f-4c99-95f8-04fc43867341 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:25.857764 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-66b61af8-f914-4c15-8a63-cf9473bdba22 req-8774517c-6b2f-4c99-95f8-04fc43867341 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:25.857937 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-66b61af8-f914-4c15-8a63-cf9473bdba22 req-8774517c-6b2f-4c99-95f8-04fc43867341 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] No waiting events found dispatching network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:25.858164 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-66b61af8-f914-4c15-8a63-cf9473bdba22 req-8774517c-6b2f-4c99-95f8-04fc43867341 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received unexpected event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 for instance with vm_state resized and task_state resize_reverting. Jun 03 01:06:25.967640 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999617282999907 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:25.967823 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998953442999891 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:25.967957 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998801265999873 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:25.970971 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Instance destroyed successfully. Jun 03 01:06:25.971543 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lazy-loading 'resources' on Instance uuid 1225d1ad-70c5-43e1-b8f0-927efb3ef6be {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:26.040242 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-646823dc-8f27-4860-88b5-0dad64dde4d2 req-8542e467-c5b1-48c3-a659-fa5c4f31f2ef service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Updated VIF entry in instance network info cache for port 08eb504a-2b3a-4306-bca5-2cd861bcf959. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:06:26.041083 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-646823dc-8f27-4860-88b5-0dad64dde4d2 req-8542e467-c5b1-48c3-a659-fa5c4f31f2ef service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Updating instance_info_cache with network_info: [{"id": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "address": "fa:16:3e:6f:53:ec", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08eb504a-2b", "ovs_interfaceid": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:26.250747 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:26.273147 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lazy-loading 'flavor' on Instance uuid 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:26.362931 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Successfully created port: 185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:06:26.476162 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-690499922',display_name='tempest-ServerActionsTestOtherB-server-690499922',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000002000',hostname='tempest-serveractionstestotherb-server-690499922',id=3,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+EmDDwoR2OvmMWSLRL3pD12IuhLKXYlFCyFD0S6tz1U811/Ppz6LfRqvK84OL/tJp7AFM3OOYK27W8pAe9Ufj1wNI9CICCs+j8JCdUBCkwgtBDQJU6o6T6RKxEkHfeyw==',key_name='tempest-keypair-122608129',keypairs=,launch_index=0,launched_at=2026-06-03T01:06:20Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=Flavor(12),node='np0000002000',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='64016d71af32442f8c9e0e2fc40a542b',ramdisk_id='',reservation_id='r-mvqoecge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1369156437',owner_user_name='tempest-ServerActionsTestOtherB-1369156437-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:06:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95a67614fa2443596fde71d819153e7',uuid=1225d1ad-70c5-43e1-b8f0-927efb3ef6be,vcpu_model=,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:06:26.476601 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converting VIF {"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:26.477874 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:26.478031 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:06:26.479227 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:26.480907 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9055a094-dc, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:26.482291 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:26.483186 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:26.488128 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:26.491401 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:26.491916 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e43616a7-6c66-420d-a54f-3ca305001402) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:26.494081 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:06:26.494923 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:26.494923 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:26.500527 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:26.508554 np0000002000 nova-compute[98288]: INFO os_vif [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') Jun 03 01:06:26.511750 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:06:26.512009 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:26.512124 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:26.512482 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:26.512720 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:06:26.512857 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:06:26.544733 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-646823dc-8f27-4860-88b5-0dad64dde4d2 req-8542e467-c5b1-48c3-a659-fa5c4f31f2ef service nova] Releasing lock "refresh_cache-71626a81-876a-40b9-ae4f-a57455bf345b" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:26.548126 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:26.548126 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:26.548126 np0000002000 nova-compute[98288]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:26.548126 np0000002000 nova-compute[98288]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:26.548126 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:26.548126 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:26.548126 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:26.548315 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:26.548315 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:26.548315 np0000002000 nova-compute[98288]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:26.548315 np0000002000 nova-compute[98288]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:26.548315 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:26.548315 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:26.548315 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:26.548486 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:06:26.548486 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '19')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:26.549336 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '20')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:26.550042 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Resulting device map defaultdict(. at 0x73e7b808cea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'): ({'sdg'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:06:26.550210 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Removing multipathed devices sdf, sdg {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:06:26.550426 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Flush multipath device 3300000004792dc3e {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:06:26.553478 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:06:26.590618 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:06:26.645416 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:06:26.697031 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:06:26.698209 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:06:26.699652 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:06:26.713579 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:06:26.713579 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:06:26.725322 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:26.759764 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.40.100,3260] Jun 03 01:06:26.759764 np0000002000 nova-compute[98288]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.40.100,3260] successful. Jun 03 01:06:26.759764 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:26.774851 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:26.790135 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:26.806479 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Successfully created port: 3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:06:26.834677 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.50.100,3260] Jun 03 01:06:26.834677 np0000002000 nova-compute[98288]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.50.100,3260] successful. Jun 03 01:06:26.834677 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:26.850402 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:26.851461 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:26.851461 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] <== disconnect_volume: return (338ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:26.851461 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:06:27.027349 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:27.027532 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:27.027648 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No VIF found with MAC fa:16:3e:6f:53:ec, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:06:27.028028 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Using config drive Jun 03 01:06:27.061641 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Booting with volume 43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 at /dev/vda Jun 03 01:06:27.102081 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:27.114098 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:06:27.133827 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:27.169790 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:06:27.170144 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:06:27.179384 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:06:27.180903 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feb8:822', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::fc16:3eff:fe5c:d4cc', 'fe80::34c3:b7ff:fe30:cb04', 'fe80::fc16:3eff:fe7f:c107', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fe29:1d7b', 'fe80::fc16:3eff:fe52:40dc', 'fe80::ec6a:1ff:fe54:5dbf', 'fe80::fc16:3eff:fe5e:4e78', 'fe80::fc16:3eff:fee5:47da'] Jun 03 01:06:27.181085 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:06:27.181259 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:06:27.181586 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:27.182940 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updating existing volume attachment record: b13f60af-afcc-483c-80ed-35de0a2fc594 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:06:27.279058 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4e73362e-6b39-45ec-92ea-a0d732b59196 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.646s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:27.536832 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:27.711173 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Successfully created port: 58487093-6f51-4a4b-968a-82b38b604734 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:06:27.806977 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Creating config drive at /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk.config Jun 03 01:06:27.809673 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps5l2qx2g {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:27.845958 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:27.848880 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps5l2qx2g" returned: 0 in 0.039s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:28.015632 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:28.015895 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:28.030500 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.073102 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "f448afac-6687-4a4a-84ff-b4478c316986" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:28.073102 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:28.073102 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "f448afac-6687-4a4a-84ff-b4478c316986-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:28.073102 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:28.073102 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:28.075653 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Terminating instance Jun 03 01:06:28.120263 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bcd11bb1-039a-4de0-9bb2-4c3a6dffb802 req-918a34de-7bc1-4d61-bdec-cddc2c4972c7 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:28.122367 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bcd11bb1-039a-4de0-9bb2-4c3a6dffb802 req-918a34de-7bc1-4d61-bdec-cddc2c4972c7 service nova] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:28.122367 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bcd11bb1-039a-4de0-9bb2-4c3a6dffb802 req-918a34de-7bc1-4d61-bdec-cddc2c4972c7 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:28.122367 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bcd11bb1-039a-4de0-9bb2-4c3a6dffb802 req-918a34de-7bc1-4d61-bdec-cddc2c4972c7 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:28.122367 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bcd11bb1-039a-4de0-9bb2-4c3a6dffb802 req-918a34de-7bc1-4d61-bdec-cddc2c4972c7 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] No waiting events found dispatching network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:28.122367 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-bcd11bb1-039a-4de0-9bb2-4c3a6dffb802 req-918a34de-7bc1-4d61-bdec-cddc2c4972c7 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received unexpected event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 for instance with vm_state resized and task_state resize_reverting. Jun 03 01:06:28.191719 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:28.191902 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:28.192095 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:28.192216 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:28.192326 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:28.196194 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Terminating instance Jun 03 01:06:28.382097 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.406749 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.489216 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.519223 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lazy-loading 'migration_context' on Instance uuid 1225d1ad-70c5-43e1-b8f0-927efb3ef6be {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:28.573253 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.574470 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.579693 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:06:28.604176 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.605851 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.626412 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.699482 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:06:28.739335 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.752143 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.767616 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.803614 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Successfully updated port: a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:06:28.823671 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.829584 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Booting with volume f21eee2a-ec1f-4025-94ec-0b807c046f78 at /dev/vdb Jun 03 01:06:28.834677 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.858844 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.876522 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-55f5f8e1-ce3d-43df-88d0-2432125c0805 req-859f68be-0f6b-464d-be43-70f29e3d0b6b service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-changed-a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:28.877249 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-55f5f8e1-ce3d-43df-88d0-2432125c0805 req-859f68be-0f6b-464d-be43-70f29e3d0b6b service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing instance network info cache due to event network-changed-a320f909-4120-4240-816d-9a98fd363e9a. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:28.877387 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-55f5f8e1-ce3d-43df-88d0-2432125c0805 req-859f68be-0f6b-464d-be43-70f29e3d0b6b service nova] Acquiring lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:28.877473 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-55f5f8e1-ce3d-43df-88d0-2432125c0805 req-859f68be-0f6b-464d-be43-70f29e3d0b6b service nova] Acquired lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:28.877598 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-55f5f8e1-ce3d-43df-88d0-2432125c0805 req-859f68be-0f6b-464d-be43-70f29e3d0b6b service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing network info cache for port a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:28.891459 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:28.897547 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:28.906357 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:06:28.929163 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:28.961715 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:06:28.962066 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:06:28.971605 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:06:28.974908 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feb8:822', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fe29:1d7b', 'fe80::fc16:3eff:fe52:40dc', 'fe80::ec6a:1ff:fe54:5dbf', 'fe80::fc16:3eff:fe5e:4e78', 'fe80::fc16:3eff:fee5:47da', 'fe80::fc16:3eff:fe6f:53ec'] Jun 03 01:06:28.975041 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:06:28.975192 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:06:28.975389 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:28.975587 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updating existing volume attachment record: 20a696f5-869b-4117-b6b7-4117bbf11a44 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:06:29.023469 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Object Instance<1225d1ad-70c5-43e1-b8f0-927efb3ef6be> lazy-loaded attributes: resources,migration_context {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:06:29.025590 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.059533 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999615779000123 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:29.068409 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.071317 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.071651 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Instance destroyed successfully. Jun 03 01:06:29.079168 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lazy-loading 'resources' on Instance uuid f448afac-6687-4a4a-84ff-b4478c316986 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:29.079168 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.081779 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999734074999878 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:29.086082 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Instance destroyed successfully. Jun 03 01:06:29.088875 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lazy-loading 'resources' on Instance uuid 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:29.097958 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.384033 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-55f5f8e1-ce3d-43df-88d0-2432125c0805 req-859f68be-0f6b-464d-be43-70f29e3d0b6b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:29.404864 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.417823 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.423176 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.453064 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.459189 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:29.459189 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] VM Started (Lifecycle Event) Jun 03 01:06:29.464668 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.492060 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-55f5f8e1-ce3d-43df-88d0-2432125c0805 req-859f68be-0f6b-464d-be43-70f29e3d0b6b service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:06:29.569136 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.581867 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-751623019-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-testmultiattachvolumeswap-server-751623019-1',id=7,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIoKC/hBS6y4mWYEV0KZGx92EtSh5A6vBfJ/tJKRNkXEEhJQmefIjtTB99y6u7LZ5KXQcYbDAiY9iUqtsaSMO3+X0lq5+bhVt0n8r+qjB2CaNerAmiAR4lZiEx+64qLpw==',key_name='tempest-keypair-895713609',keypairs=,launch_index=0,launched_at=2026-06-03T01:05:16Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='497a75226ead41d0b5de0b5e17c7c55c',ramdisk_id='',reservation_id='r-4p6dfowh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-2138682875',owner_user_name='tempest-TestMultiAttachVolumeSwap-2138682875-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:05:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f245211bf5994e21bfe59c811ea624a0',uuid=f448afac-6687-4a4a-84ff-b4478c316986,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "address": "fa:16:3e:5c:d4:cc", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ca89c7-5e", "ovs_interfaceid": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:06:29.582350 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Converting VIF {"id": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "address": "fa:16:3e:5c:d4:cc", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ca89c7-5e", "ovs_interfaceid": "c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:29.583025 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:d4:cc,bridge_name='br-int',has_traffic_filtering=True,id=c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ca89c7-5e') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:29.583352 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:d4:cc,bridge_name='br-int',has_traffic_filtering=True,id=c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ca89c7-5e') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:06:29.585333 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.585595 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9ca89c7-5e, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:29.592861 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:29.599186 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-751623019-2',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-testmultiattachvolumeswap-server-751623019-2',id=8,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIoKC/hBS6y4mWYEV0KZGx92EtSh5A6vBfJ/tJKRNkXEEhJQmefIjtTB99y6u7LZ5KXQcYbDAiY9iUqtsaSMO3+X0lq5+bhVt0n8r+qjB2CaNerAmiAR4lZiEx+64qLpw==',key_name='tempest-keypair-895713609',keypairs=,launch_index=1,launched_at=2026-06-03T01:05:16Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='497a75226ead41d0b5de0b5e17c7c55c',ramdisk_id='',reservation_id='r-4p6dfowh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-2138682875',owner_user_name='tempest-TestMultiAttachVolumeSwap-2138682875-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:05:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f245211bf5994e21bfe59c811ea624a0',uuid=2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "address": "fa:16:3e:7f:c1:07", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d1283-77", "ovs_interfaceid": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:06:29.599186 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Converting VIF {"id": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "address": "fa:16:3e:7f:c1:07", "network": {"id": "f9786fb8-cce5-4358-836d-583dd31e4548", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-127333555-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "497a75226ead41d0b5de0b5e17c7c55c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d1283-77", "ovs_interfaceid": "d20d1283-77a1-445e-ae92-60ef3ff039d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:29.599186 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:c1:07,bridge_name='br-int',has_traffic_filtering=True,id=d20d1283-77a1-445e-ae92-60ef3ff039d5,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d1283-77') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:29.599628 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:c1:07,bridge_name='br-int',has_traffic_filtering=True,id=d20d1283-77a1-445e-ae92-60ef3ff039d5,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d1283-77') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:06:29.601610 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.608991 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.608991 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.608991 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd20d1283-77, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:29.610197 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:29.611825 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.613649 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.613800 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10da92e2-0977-441b-89c2-db11b8283462) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:29.614425 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.614852 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:29.617314 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.618534 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.618534 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30eb251e-33c7-4674-bc5b-0822a7339b4c) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:29.620995 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:29.621215 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:29.625974 np0000002000 nova-compute[98288]: INFO os_vif [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:c1:07,bridge_name='br-int',has_traffic_filtering=True,id=d20d1283-77a1-445e-ae92-60ef3ff039d5,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d1283-77') Jun 03 01:06:29.625974 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Deleting instance files /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5_del Jun 03 01:06:29.626693 np0000002000 nova-compute[98288]: INFO os_vif [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:d4:cc,bridge_name='br-int',has_traffic_filtering=True,id=c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33,network=Network(f9786fb8-cce5-4358-836d-583dd31e4548),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ca89c7-5e') Jun 03 01:06:29.626693 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Deleting instance files /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986_del Jun 03 01:06:29.628223 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Deletion of /opt/stack/data/nova/instances/2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5_del complete Jun 03 01:06:29.630542 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Deletion of /opt/stack/data/nova/instances/f448afac-6687-4a4a-84ff-b4478c316986_del complete Jun 03 01:06:29.702532 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-55f5f8e1-ce3d-43df-88d0-2432125c0805 req-859f68be-0f6b-464d-be43-70f29e3d0b6b service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:29.709453 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:06:29.709959 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:06:29.921133 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Successfully updated port: ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:06:29.961636 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:29.963663 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:29.963835 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] VM Paused (Lifecycle Event) Jun 03 01:06:30.143755 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Took 1.44 seconds to destroy the instance on the hypervisor. Jun 03 01:06:30.144263 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Took 1.56 seconds to destroy the instance on the hypervisor. Jun 03 01:06:30.145360 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:06:30.145707 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:06:30.145980 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:06:30.146195 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:30.147585 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:06:30.148171 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:06:30.148339 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: f448afac-6687-4a4a-84ff-b4478c316986] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:06:30.149062 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:30.197068 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Received event network-vif-plugged-08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:30.197666 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] Acquiring lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:30.197963 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] Lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:30.197963 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] Lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:30.198158 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Processing event network-vif-plugged-08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:06:30.198289 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Received event network-vif-plugged-08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:30.198782 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:06:30.198984 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] Acquiring lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:30.199145 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] Lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:30.199296 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] Lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:30.199437 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] No waiting events found dispatching network-vif-plugged-08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:30.199790 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Received unexpected event network-vif-plugged-08eb504a-2b3a-4306-bca5-2cd861bcf959 for instance with vm_state building and task_state spawning. Jun 03 01:06:30.199893 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-changed-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:30.199994 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing instance network info cache due to event network-changed-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:30.200117 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] Acquiring lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:30.205021 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:06:30.205634 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-55f5f8e1-ce3d-43df-88d0-2432125c0805 req-859f68be-0f6b-464d-be43-70f29e3d0b6b service nova] Releasing lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:30.207033 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Instance spawned successfully. Jun 03 01:06:30.207450 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:06:30.208536 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] Acquired lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:30.208729 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing network info cache for port ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:30.211924 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:06:30.267617 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:30.270909 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:30.467002 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:30.469418 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:30.469609 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] VM Resumed (Lifecycle Event) Jun 03 01:06:30.587148 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Booting with volume e2ae67a3-aa4d-424f-ba5e-c041a6f818df at /dev/vdc Jun 03 01:06:30.633587 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:30.644133 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:06:30.668635 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:30.700295 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:06:30.700674 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:06:30.712177 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:30.715009 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:06:30.742161 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feb8:822', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fe29:1d7b', 'fe80::fc16:3eff:fe52:40dc', 'fe80::ec6a:1ff:fe54:5dbf', 'fe80::fc16:3eff:fe5e:4e78', 'fe80::fc16:3eff:fee5:47da', 'fe80::fc16:3eff:fe6f:53ec'] Jun 03 01:06:30.742339 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:06:30.742482 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:06:30.746888 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:30.747070 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updating existing volume attachment record: 8c9f311e-81c9-4c1a-944a-b56f80b12635 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:06:30.751829 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:30.752172 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:30.752640 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:30.753079 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:30.753434 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:30.753804 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:30.894489 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-f81916b1-dbab-46f6-89c8-f341e222a718 req-3d8b2da5-d9e2-463a-bc88-a5e0b0deaaeb service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Received event network-vif-deleted-d20d1283-77a1-445e-ae92-60ef3ff039d5 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:30.894619 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-f81916b1-dbab-46f6-89c8-f341e222a718 req-3d8b2da5-d9e2-463a-bc88-a5e0b0deaaeb service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Neutron deleted interface d20d1283-77a1-445e-ae92-60ef3ff039d5; detaching it from the instance and deleting it from the info cache Jun 03 01:06:30.895821 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-f81916b1-dbab-46f6-89c8-f341e222a718 req-3d8b2da5-d9e2-463a-bc88-a5e0b0deaaeb service nova] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Detach interface failed, port_id=d20d1283-77a1-445e-ae92-60ef3ff039d5, reason: Instance 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:06:30.909147 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:06:30.964144 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2e3d8cb5-467d-4c65-9584-11ef19effd1b req-8aaf3a82-678c-4f43-8b9a-e97ec3c07a21 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Received event network-vif-deleted-c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:30.964276 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-2e3d8cb5-467d-4c65-9584-11ef19effd1b req-8aaf3a82-678c-4f43-8b9a-e97ec3c07a21 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Neutron deleted interface c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33; detaching it from the instance and deleting it from the info cache Jun 03 01:06:30.970749 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2e3d8cb5-467d-4c65-9584-11ef19effd1b req-8aaf3a82-678c-4f43-8b9a-e97ec3c07a21 service nova] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Detach interface failed, port_id=c9ca89c7-5e83-4cc2-a4d6-95d9f2cabf33, reason: Instance f448afac-6687-4a4a-84ff-b4478c316986 could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:06:30.971840 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:30.973033 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:31.027002 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:31.090939 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:31.118189 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Successfully updated port: 2b0eef10-c9f6-488a-9800-6e7d807e7336 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:06:31.248413 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.232s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:31.248896 np0000002000 nova-compute[98288]: DEBUG nova.compute.rpcapi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98288) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 03 01:06:31.263724 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Took 7.39 seconds to spawn the instance on the hypervisor. Jun 03 01:06:31.268094 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:31.343945 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:31.475838 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:06:31.529197 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Took 1.38 seconds to deallocate network for instance. Jun 03 01:06:31.592847 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-297127d6-1d00-4cd7-8adc-fa5dc442a476 req-ffaea87b-ba0c-4bb9-9c08-a830227b2e2b service nova] Releasing lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:31.778539 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Took 14.36 seconds to build instance. Jun 03 01:06:31.845503 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Took 1.70 seconds to deallocate network for instance. Jun 03 01:06:32.034364 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:32.034722 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:32.058964 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Successfully updated port: f898b240-5ec0-4735-90c6-f8aa562b0cac {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:06:32.146142 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:32.146142 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:32.280710 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-265e6203-d2de-4662-b276-f3b232712a10 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "71626a81-876a-40b9-ae4f-a57455bf345b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.872s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:32.337512 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bc5c340a-a9f0-46af-b164-785b6e4bcb26 req-04ff94b6-8461-404c-8eac-79679de9e617 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-changed-f898b240-5ec0-4735-90c6-f8aa562b0cac {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:32.342528 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bc5c340a-a9f0-46af-b164-785b6e4bcb26 req-04ff94b6-8461-404c-8eac-79679de9e617 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing instance network info cache due to event network-changed-f898b240-5ec0-4735-90c6-f8aa562b0cac. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:32.342839 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bc5c340a-a9f0-46af-b164-785b6e4bcb26 req-04ff94b6-8461-404c-8eac-79679de9e617 service nova] Acquiring lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:32.342958 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bc5c340a-a9f0-46af-b164-785b6e4bcb26 req-04ff94b6-8461-404c-8eac-79679de9e617 service nova] Acquired lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:32.343072 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-bc5c340a-a9f0-46af-b164-785b6e4bcb26 req-04ff94b6-8461-404c-8eac-79679de9e617 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing network info cache for port f898b240-5ec0-4735-90c6-f8aa562b0cac {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:32.352338 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:32.654136 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:06:32.669726 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:06:32.669960 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:06:32.811770 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Swapping old allocation on dict_keys(['e5e0d48c-b64b-4e03-864c-efd360069abb']) held by migration 8708136b-03fb-48d0-97ba-1773f515e332 for instance Jun 03 01:06:32.845878 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-bc5c340a-a9f0-46af-b164-785b6e4bcb26 req-04ff94b6-8461-404c-8eac-79679de9e617 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:32.848972 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:32.871866 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:06:32.872949 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:06:32.873388 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Creating image(s) Jun 03 01:06:32.873873 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Did not create local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} Jun 03 01:06:32.874039 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Ensure instance console log exists: /opt/stack/data/nova/instances/870f3e49-a1b4-4a7f-a936-66ed2280b505/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:06:32.874360 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:32.874552 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:32.874694 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:32.919773 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Overwriting current allocation {'allocations': {'e5e0d48c-b64b-4e03-864c-efd360069abb': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 20}}, 'project_id': '64016d71af32442f8c9e0e2fc40a542b', 'user_id': 'a95a67614fa2443596fde71d819153e7', 'consumer_generation': 1} on consumer 1225d1ad-70c5-43e1-b8f0-927efb3ef6be {{(pid=98288) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}} Jun 03 01:06:32.948385 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-bc5c340a-a9f0-46af-b164-785b6e4bcb26 req-04ff94b6-8461-404c-8eac-79679de9e617 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:06:32.967895 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-3863cff1-40c5-4457-bd20-03c2c2da3163 req-81b506ef-af62-4b2b-b6ef-c7552d88bc50 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-changed-2b0eef10-c9f6-488a-9800-6e7d807e7336 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:32.968021 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-3863cff1-40c5-4457-bd20-03c2c2da3163 req-81b506ef-af62-4b2b-b6ef-c7552d88bc50 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing instance network info cache due to event network-changed-2b0eef10-c9f6-488a-9800-6e7d807e7336. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:32.968161 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-3863cff1-40c5-4457-bd20-03c2c2da3163 req-81b506ef-af62-4b2b-b6ef-c7552d88bc50 service nova] Acquiring lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:33.000016 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:33.066725 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Successfully updated port: 185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:06:33.094759 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-bc5c340a-a9f0-46af-b164-785b6e4bcb26 req-04ff94b6-8461-404c-8eac-79679de9e617 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:33.099938 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:33.100772 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquired lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:33.102743 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:06:33.172747 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:06:33.199498 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:33.596943 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bc5c340a-a9f0-46af-b164-785b6e4bcb26 req-04ff94b6-8461-404c-8eac-79679de9e617 service nova] Releasing lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:33.597870 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-3863cff1-40c5-4457-bd20-03c2c2da3163 req-81b506ef-af62-4b2b-b6ef-c7552d88bc50 service nova] Acquired lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:33.597870 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-3863cff1-40c5-4457-bd20-03c2c2da3163 req-81b506ef-af62-4b2b-b6ef-c7552d88bc50 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing network info cache for port 2b0eef10-c9f6-488a-9800-6e7d807e7336 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:33.604967 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:33.679311 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.644s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:33.680744 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.327s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:33.782141 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Deleted allocations for instance 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5 Jun 03 01:06:33.919560 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:34.016546 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:34.100529 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-3863cff1-40c5-4457-bd20-03c2c2da3163 req-81b506ef-af62-4b2b-b6ef-c7552d88bc50 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:34.203144 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updating instance_info_cache with network_info: [{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:34.221941 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Successfully updated port: 3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:06:34.236858 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-3863cff1-40c5-4457-bd20-03c2c2da3163 req-81b506ef-af62-4b2b-b6ef-c7552d88bc50 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:06:34.279832 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-a790b6fe-126b-47fc-b954-b0afcd567339 req-5824a091-d55b-4aa6-82f0-d2cede3f4658 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-changed-3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:34.280362 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-a790b6fe-126b-47fc-b954-b0afcd567339 req-5824a091-d55b-4aa6-82f0-d2cede3f4658 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing instance network info cache due to event network-changed-3239f51b-2bbd-4d49-a354-7e0a6a03549a. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:34.280800 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-a790b6fe-126b-47fc-b954-b0afcd567339 req-5824a091-d55b-4aa6-82f0-d2cede3f4658 service nova] Acquiring lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:34.411813 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bb23708a-7e92-4d30-b42a-3a91cce3b9fd req-a1b605d2-3800-444b-8198-8383c7db4505 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-changed-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:34.411813 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bb23708a-7e92-4d30-b42a-3a91cce3b9fd req-a1b605d2-3800-444b-8198-8383c7db4505 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing instance network info cache due to event network-changed-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:34.411813 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bb23708a-7e92-4d30-b42a-3a91cce3b9fd req-a1b605d2-3800-444b-8198-8383c7db4505 service nova] Acquiring lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:34.422108 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-3863cff1-40c5-4457-bd20-03c2c2da3163 req-81b506ef-af62-4b2b-b6ef-c7552d88bc50 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:34.423635 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:06:34.424561 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:06:34.427209 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] instance snapshotting Jun 03 01:06:34.516426 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Beginning live snapshot process Jun 03 01:06:34.618050 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:34.706149 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Releasing lock "refresh_cache-1225d1ad-70c5-43e1-b8f0-927efb3ef6be" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:34.706534 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:34.715472 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:06:34.736560 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:34.767666 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:06:34.767963 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:06:34.775389 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:06:34.776567 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feb8:822', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fe29:1d7b', 'fe80::fc16:3eff:fe52:40dc', 'fe80::ec6a:1ff:fe54:5dbf', 'fe80::fc16:3eff:fe5e:4e78', 'fe80::fc16:3eff:fee5:47da', 'fe80::fc16:3eff:fe6f:53ec'] Jun 03 01:06:34.776748 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:06:34.776781 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:06:34.776990 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] <== get_connector_properties: return (70ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:34.791299 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-219c4372-7cb3-45d7-91db-e9cf3b496412 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.599s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:34.926401 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-3863cff1-40c5-4457-bd20-03c2c2da3163 req-81b506ef-af62-4b2b-b6ef-c7552d88bc50 service nova] Releasing lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:34.928412 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:06:34.935280 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-a790b6fe-126b-47fc-b954-b0afcd567339 req-5824a091-d55b-4aa6-82f0-d2cede3f4658 service nova] Acquired lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:34.941464 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-a790b6fe-126b-47fc-b954-b0afcd567339 req-5824a091-d55b-4aa6-82f0-d2cede3f4658 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing network info cache for port 3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:35.241713 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Successfully updated port: 58487093-6f51-4a4b-968a-82b38b604734 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:06:35.444114 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.765s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:35.445871 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.245s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:35.447605 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-a790b6fe-126b-47fc-b954-b0afcd567339 req-5824a091-d55b-4aa6-82f0-d2cede3f4658 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:35.452331 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:06:35.452599 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Claim successful on node np0000002000 Jun 03 01:06:35.519773 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Deleted allocations for instance f448afac-6687-4a4a-84ff-b4478c316986 Jun 03 01:06:35.562299 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-a790b6fe-126b-47fc-b954-b0afcd567339 req-5824a091-d55b-4aa6-82f0-d2cede3f4658 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:06:35.698393 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-a790b6fe-126b-47fc-b954-b0afcd567339 req-5824a091-d55b-4aa6-82f0-d2cede3f4658 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:35.742916 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:35.875453 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Starting finish_revert_migration {{(pid=98288) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}} Jun 03 01:06:35.892097 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Start _get_guest_xml network_info=[{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '1a54c863-c24b-45a5-b2aa-2ad139600d8f', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '1225d1ad-70c5-43e1-b8f0-927efb3ef6be', 'attached_at': '2026-06-03T01:06:35.000000', 'detached_at': '', 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'serial': '0782cb8d-527b-47ac-898d-a53b667d4af1'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:06:35.894127 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:06:35.895346 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-690499922', uuid='1225d1ad-70c5-43e1-b8f0-927efb3ef6be'), owner=OwnerMeta(userid='a95a67614fa2443596fde71d819153e7', username='tempest-ServerActionsTestOtherB-1369156437-project-member', projectid='64016d71af32442f8c9e0e2fc40a542b', projectname='tempest-ServerActionsTestOtherB-1369156437'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448795.894947) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:06:35.896510 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:06:35.897185 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:06:35.897872 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:06:35.898078 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:06:35.899026 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:06:35.899303 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format='bare',created_at=,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=1,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=,status=,tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:06:35.899523 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:06:35.899883 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:06:35.899883 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:06:35.900107 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:06:35.900107 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:06:35.900347 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:06:35.900489 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:06:35.900640 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:06:35.900785 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:06:35.900934 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:06:35.901522 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1225d1ad-70c5-43e1-b8f0-927efb3ef6be {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:36.032494 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk --force-share --output=json -f qcow2 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:36.109415 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk --force-share --output=json -f qcow2" returned: 0 in 0.077s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:36.109860 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk --force-share --output=json -f qcow2 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:36.183104 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk --force-share --output=json -f qcow2" returned: 0 in 0.073s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:36.184074 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:36.186710 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:36.187117 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:36.201557 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-a790b6fe-126b-47fc-b954-b0afcd567339 req-5824a091-d55b-4aa6-82f0-d2cede3f4658 service nova] Releasing lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:36.202458 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bb23708a-7e92-4d30-b42a-3a91cce3b9fd req-a1b605d2-3800-444b-8198-8383c7db4505 service nova] Acquired lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:36.202725 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-bb23708a-7e92-4d30-b42a-3a91cce3b9fd req-a1b605d2-3800-444b-8198-8383c7db4505 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing network info cache for port 185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:36.259891 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.073s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:36.260302 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp89e_0zkn/0351b9aa2d404a57b528231c66580540.delta 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:36.306969 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp89e_0zkn/0351b9aa2d404a57b528231c66580540.delta 1073741824" returned: 0 in 0.046s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:36.307405 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Quiescing instance not available: QEMU guest agent is not enabled. Jun 03 01:06:36.340608 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-32be8ec1-ec0c-4bc2-acb2-fbf443076f75 req-ffb1110a-fd78-4076-85cd-06828e1f3155 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-changed-58487093-6f51-4a4b-968a-82b38b604734 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:36.341142 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-32be8ec1-ec0c-4bc2-acb2-fbf443076f75 req-ffb1110a-fd78-4076-85cd-06828e1f3155 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing instance network info cache due to event network-changed-58487093-6f51-4a4b-968a-82b38b604734. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:36.341283 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-32be8ec1-ec0c-4bc2-acb2-fbf443076f75 req-ffb1110a-fd78-4076-85cd-06828e1f3155 service nova] Acquiring lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:36.414527 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.config --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:36.492029 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.config --force-share --output=json" returned: 0 in 0.077s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:36.492608 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "/opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:36.492911 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "/opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:36.493677 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "/opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:36.494204 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:06:36.494729 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:36.494944 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:36.495394 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:36.495946 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:06:36.511320 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:36.511999 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:36.512458 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:36.512646 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:36.513111 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:36.513307 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:36.528571 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:36.528571 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:36.529341 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:36.529341 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:36.529638 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8fa62014-39e6-4987-ad27-69f550707de0 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Lock "f448afac-6687-4a4a-84ff-b4478c316986" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.458s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:36.541184 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1] added Jun 03 01:06:36.541184 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:36.541184 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:36.541184 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:36.541184 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:36.541184 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:36.541184 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:36.541569 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:36.541569 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:36.541651 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:36.545578 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1] added Jun 03 01:06:36.545578 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:36.545578 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:36.545578 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:36.545578 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:36.545578 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:36.545578 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:36.545842 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:36.545890 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0326(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:36.546081 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:36.557774 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 03 01:06:36.559617 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 03 01:06:36.607649 np0000002000 nova-compute[98288]: DEBUG nova.privsep.utils [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 03 01:06:36.608775 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp89e_0zkn/0351b9aa2d404a57b528231c66580540.delta /opt/stack/data/nova/instances/snapshots/tmp89e_0zkn/0351b9aa2d404a57b528231c66580540 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:36.706495 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-bb23708a-7e92-4d30-b42a-3a91cce3b9fd req-a1b605d2-3800-444b-8198-8383c7db4505 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:36.713530 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp89e_0zkn/0351b9aa2d404a57b528231c66580540.delta /opt/stack/data/nova/instances/snapshots/tmp89e_0zkn/0351b9aa2d404a57b528231c66580540" returned: 0 in 0.105s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:36.716590 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Snapshot extracted, beginning image upload Jun 03 01:06:36.813333 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-bb23708a-7e92-4d30-b42a-3a91cce3b9fd req-a1b605d2-3800-444b-8198-8383c7db4505 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:06:37.024588 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:06:37.025057 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:06:37.032294 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-bb23708a-7e92-4d30-b42a-3a91cce3b9fd req-a1b605d2-3800-444b-8198-8383c7db4505 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:37.528286 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:06:37.538677 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bb23708a-7e92-4d30-b42a-3a91cce3b9fd req-a1b605d2-3800-444b-8198-8383c7db4505 service nova] Releasing lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:37.539186 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquired lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:37.539408 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:06:37.542135 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:37.546454 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:37.553775 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:37.561524 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:37.569470 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:37.574127 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:37.582009 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.582009 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.582009 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.582009 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.582009 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:37.582009 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.582009 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.582009 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.582009 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.582009 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:37.586900 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.586900 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.586900 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.586900 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.586900 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:37.587089 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.587089 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.587089 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.587089 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.587089 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:37.614405 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.40.100,3260] Jun 03 01:06:37.614405 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.40.100,3260] successful. Jun 03 01:06:37.614405 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:37.624225 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:37.628157 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.50.100,3260] Jun 03 01:06:37.628157 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.50.100,3260] successful. Jun 03 01:06:37.628157 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:37.639805 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:37.640874 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.640874 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.640874 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:37.640874 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:37.640874 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.640874 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.640874 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:37.641616 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.641616 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.641616 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:37.641616 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:37.641616 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.641616 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.641616 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:37.642605 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:37.644022 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:37.644022 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] HCTL ('11', '-', '-', 0) found on session 21 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:37.644022 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] HCTL ('12', '-', '-', 0) found on session 22 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:37.661063 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:37.665467 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Searching for a device in session 21 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:37.665467 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:37.679047 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Searching for a device in session 22 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:37.679047 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:37.863914 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:38.035900 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.592s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:38.036418 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:06:38.119110 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:06:38.284686 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:38.513177 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:06:38.542809 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:06:38.543231 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:06:38.543468 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:38.543645 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:38.615649 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:38.634730 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4586ad9e4c304b0fa9a960267667ac64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e01380196548bbbe8f5f9e9147494b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:06:38.934756 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:39.046039 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:06:39.090336 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Successfully created port: 832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:06:39.181940 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Snapshot image upload complete Jun 03 01:06:39.182187 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-8add9e68-aa93-400f-8185-edc4fa956c94 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Took 4.75 seconds to snapshot the instance on the hypervisor. Jun 03 01:06:39.312510 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:39.533559 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Found WWN 3300000004792dc3e for multipath device dm-2 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:06:39.533909 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:39.534145 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000004792dc3e', 'path': '/dev/dm-2', 'multipath_id': '3300000004792dc3e'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:39.534301 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004792dc3e', 'path': '/dev/dm-2', 'multipath_id': '3300000004792dc3e'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:06:39.549153 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:06:39.619675 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:39.657499 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Successfully updated port: 832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:06:39.705057 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-50787179-74ee-49d9-b90c-40d2129f4126 req-16b80f12-10f6-43fb-9760-fa5597a1d30a service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-changed-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:39.705288 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-50787179-74ee-49d9-b90c-40d2129f4126 req-16b80f12-10f6-43fb-9760-fa5597a1d30a service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Refreshing instance network info cache due to event network-changed-832eebb3-1a18-433e-8480-9be9f07a10f3. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:39.705397 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-50787179-74ee-49d9-b90c-40d2129f4126 req-16b80f12-10f6-43fb-9760-fa5597a1d30a service nova] Acquiring lock "refresh_cache-d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:39.705464 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-50787179-74ee-49d9-b90c-40d2129f4126 req-16b80f12-10f6-43fb-9760-fa5597a1d30a service nova] Acquired lock "refresh_cache-d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:39.705621 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-50787179-74ee-49d9-b90c-40d2129f4126 req-16b80f12-10f6-43fb-9760-fa5597a1d30a service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Refreshing network info cache for port 832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:39.730648 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:40.041706 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-690499922',display_name='tempest-ServerActionsTestOtherB-server-690499922',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serveractionstestotherb-server-690499922',id=3,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+EmDDwoR2OvmMWSLRL3pD12IuhLKXYlFCyFD0S6tz1U811/Ppz6LfRqvK84OL/tJp7AFM3OOYK27W8pAe9Ufj1wNI9CICCs+j8JCdUBCkwgtBDQJU6o6T6RKxEkHfeyw==',key_name='tempest-keypair-122608129',keypairs=,launch_index=0,launched_at=2026-06-03T01:06:20Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002000',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='64016d71af32442f8c9e0e2fc40a542b',ramdisk_id='',reservation_id='r-mvqoecge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1369156437',owner_user_name='tempest-ServerActionsTestOtherB-1369156437-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95a67614fa2443596fde71d819153e7',uuid=1225d1ad-70c5-43e1-b8f0-927efb3ef6be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:40.042294 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converting VIF {"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:40.042700 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] End _get_guest_xml xml= Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: instance-00000003 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 196608 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: tempest-ServerActionsTestOtherB-server-690499922 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 2026-06-03 01:06:35 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 192 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: True Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: bare Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: ide Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: pc Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: tempest-ServerActionsTestOtherB-1369156437-project-member Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: tempest-ServerActionsTestOtherB-1369156437 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: hvm Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 128 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: 0782cb8d-527b-47ac-898d-a53b667d4af1 Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: Jun 03 01:06:40.044358 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:06:40.046357 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Preparing to wait for external event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:40.046357 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:40.046357 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:40.046357 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:40.046615 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-690499922',display_name='tempest-ServerActionsTestOtherB-server-690499922',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serveractionstestotherb-server-690499922',id=3,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+EmDDwoR2OvmMWSLRL3pD12IuhLKXYlFCyFD0S6tz1U811/Ppz6LfRqvK84OL/tJp7AFM3OOYK27W8pAe9Ufj1wNI9CICCs+j8JCdUBCkwgtBDQJU6o6T6RKxEkHfeyw==',key_name='tempest-keypair-122608129',keypairs=,launch_index=0,launched_at=2026-06-03T01:06:20Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000002000',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='64016d71af32442f8c9e0e2fc40a542b',ramdisk_id='',reservation_id='r-mvqoecge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1369156437',owner_user_name='tempest-ServerActionsTestOtherB-1369156437-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95a67614fa2443596fde71d819153e7',uuid=1225d1ad-70c5-43e1-b8f0-927efb3ef6be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:40.046615 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converting VIF {"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:40.046812 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:40.046812 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:40.046812 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:40.046812 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:40.047011 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:40.048485 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:40.048485 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9131e6e7-d4af-574b-b318-b6addccb32fa', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:40.056729 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:40.058286 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:40.063505 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:40.065728 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:40.066087 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9055a094-dc, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:40.066392 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9055a094-dc, col_values=(('qos', UUID('c2aa654f-f4d7-43d0-bcdc-5137b14db78c')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:40.066571 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9055a094-dc, col_values=(('external_ids', {'iface-id': '9055a094-dc81-45da-9637-48b820c58772', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:15:36', 'vm-uuid': '1225d1ad-70c5-43e1-b8f0-927efb3ef6be'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:40.067337 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:40.068533 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:40.073586 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:40.074663 np0000002000 nova-compute[98288]: INFO os_vif [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') Jun 03 01:06:40.161236 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "refresh_cache-d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:40.210148 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-50787179-74ee-49d9-b90c-40d2129f4126 req-16b80f12-10f6-43fb-9760-fa5597a1d30a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:40.297526 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-50787179-74ee-49d9-b90c-40d2129f4126 req-16b80f12-10f6-43fb-9760-fa5597a1d30a service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:06:40.363692 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:40.488165 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-50787179-74ee-49d9-b90c-40d2129f4126 req-16b80f12-10f6-43fb-9760-fa5597a1d30a service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:40.491649 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updating instance_info_cache with network_info: [{"id": "a320f909-4120-4240-816d-9a98fd363e9a", "address": "fa:16:3e:51:07:53", "network": {"id": "d10ab19a-aab5-4e75-a74f-de7b6c54ff1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1300013310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa320f909-41", "ovs_interfaceid": "a320f909-4120-4240-816d-9a98fd363e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "address": "fa:16:3e:a8:11:d0", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7d0a64-f5", "ovs_interfaceid": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "address": "fa:16:3e:e3:c3:ae", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0eef10-c9", "ovs_interfaceid": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "address": "fa:16:3e:b7:f3:8b", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf898b240-5e", "ovs_interfaceid": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "address": "fa:16:3e:80:4c:19", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap185ebfc4-a0", "ovs_interfaceid": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "address": "fa:16:3e:23:58:90", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3239f51b-2b", "ovs_interfaceid": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58487093-6f51-4a4b-968a-82b38b604734", "address": "fa:16:3e:60:04:19", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58487093-6f", "ovs_interfaceid": "58487093-6f51-4a4b-968a-82b38b604734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:40.532568 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:40.566881 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:06:40.570088 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:06:40.570088 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Creating image(s) Jun 03 01:06:40.570088 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:40.570088 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "/opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:40.570088 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "/opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:40.570088 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:40.570818 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:40.573136 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:40.574103 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:40.657463 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:40.671352 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.097s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:40.672608 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:40.673070 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:40.673589 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:40.677514 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:06:40.678236 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:40.775974 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.098s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:40.777977 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:40.811402 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-6b6334ae-60ed-4360-8e6f-38892bb4a30a req-690347cd-da0e-4c9c-b1d9-d2e441998722 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:40.812738 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-6b6334ae-60ed-4360-8e6f-38892bb4a30a req-690347cd-da0e-4c9c-b1d9-d2e441998722 service nova] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:40.812994 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-6b6334ae-60ed-4360-8e6f-38892bb4a30a req-690347cd-da0e-4c9c-b1d9-d2e441998722 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:40.813194 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-6b6334ae-60ed-4360-8e6f-38892bb4a30a req-690347cd-da0e-4c9c-b1d9-d2e441998722 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:40.813381 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-6b6334ae-60ed-4360-8e6f-38892bb4a30a req-690347cd-da0e-4c9c-b1d9-d2e441998722 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Processing event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:06:40.828309 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk 1073741824" returned: 0 in 0.052s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:40.829939 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.156s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:40.829939 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:40.914663 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.085s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:40.915254 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:06:40.915620 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:40.948547 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:40.954765 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:40.968298 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0014946199999030796 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:40.968392 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:40.968545 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.0905150339999636 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:40.968733 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=3.0904284959999586 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:40.969952 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:40.970470 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] VM Stopped (Lifecycle Event) Jun 03 01:06:40.974151 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:40.994551 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-50787179-74ee-49d9-b90c-40d2129f4126 req-16b80f12-10f6-43fb-9760-fa5597a1d30a service nova] Releasing lock "refresh_cache-d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:40.995381 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquired lock "refresh_cache-d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:40.995554 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:06:40.997840 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Releasing lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:40.998554 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Instance network_info: |[{"id": "a320f909-4120-4240-816d-9a98fd363e9a", "address": "fa:16:3e:51:07:53", "network": {"id": "d10ab19a-aab5-4e75-a74f-de7b6c54ff1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1300013310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa320f909-41", "ovs_interfaceid": "a320f909-4120-4240-816d-9a98fd363e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "address": "fa:16:3e:a8:11:d0", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7d0a64-f5", "ovs_interfaceid": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "address": "fa:16:3e:e3:c3:ae", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0eef10-c9", "ovs_interfaceid": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "address": "fa:16:3e:b7:f3:8b", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf898b240-5e", "ovs_interfaceid": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "address": "fa:16:3e:80:4c:19", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap185ebfc4-a0", "ovs_interfaceid": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "address": "fa:16:3e:23:58:90", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3239f51b-2b", "ovs_interfaceid": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58487093-6f51-4a4b-968a-82b38b604734", "address": "fa:16:3e:60:04:19", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58487093-6f", "ovs_interfaceid": "58487093-6f51-4a4b-968a-82b38b604734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:06:40.998907 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-32be8ec1-ec0c-4bc2-acb2-fbf443076f75 req-ffb1110a-fd78-4076-85cd-06828e1f3155 service nova] Acquired lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:40.999040 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-32be8ec1-ec0c-4bc2-acb2-fbf443076f75 req-ffb1110a-fd78-4076-85cd-06828e1f3155 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing network info cache for port 58487093-6f51-4a4b-968a-82b38b604734 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:41.000875 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Start _get_guest_xml network_info=[{"id": "a320f909-4120-4240-816d-9a98fd363e9a", "address": "fa:16:3e:51:07:53", "network": {"id": "d10ab19a-aab5-4e75-a74f-de7b6c54ff1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1300013310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa320f909-41", "ovs_interfaceid": "a320f909-4120-4240-816d-9a98fd363e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "address": "fa:16:3e:a8:11:d0", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7d0a64-f5", "ovs_interfaceid": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "address": "fa:16:3e:e3:c3:ae", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0eef10-c9", "ovs_interfaceid": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "address": "fa:16:3e:b7:f3:8b", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf898b240-5e", "ovs_interfaceid": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "address": "fa:16:3e:80:4c:19", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap185ebfc4-a0", "ovs_interfaceid": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "address": "fa:16:3e:23:58:90", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3239f51b-2b", "ovs_interfaceid": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58487093-6f51-4a4b-968a-82b38b604734", "address": "fa:16:3e:60:04:19", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58487093-6f", "ovs_interfaceid": "58487093-6f51-4a4b-968a-82b38b604734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'b13f60af-afcc-483c-80ed-35de0a2fc594', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '870f3e49-a1b4-4a7f-a936-66ed2280b505', 'attached_at': '', 'detached_at': '', 'volume_id': '43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'serial': '43ca1640-5e7c-4fa7-b67d-1b75597eeeb7'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '20a696f5-869b-4117-b6b7-4117bbf11a44', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f21eee2a-ec1f-4025-94ec-0b807c046f78', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '870f3e49-a1b4-4a7f-a936-66ed2280b505', 'attached_at': '', 'detached_at': '', 'volume_id': 'f21eee2a-ec1f-4025-94ec-0b807c046f78', 'serial': 'f21eee2a-ec1f-4025-94ec-0b807c046f78'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '8c9f311e-81c9-4c1a-944a-b56f80b12635', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '870f3e49-a1b4-4a7f-a936-66ed2280b505', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'serial': 'e2ae67a3-aa4d-424f-ba5e-c041a6f818df'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:06:41.014794 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:06:41.017060 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1979192484', uuid='870f3e49-a1b4-4a7f-a936-66ed2280b505'), owner=OwnerMeta(userid='34ccf4f2b4d0406e9688c5b64264c051', username='tempest-TaggedBootDevicesTest-1757420274-project-member', projectid='7f0b405f69b049b390b824dd46c5fa95', projectname='tempest-TaggedBootDevicesTest-1757420274'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a320f909-4120-4240-816d-9a98fd363e9a", "address": "fa:16:3e:51:07:53", "network": {"id": "d10ab19a-aab5-4e75-a74f-de7b6c54ff1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1300013310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa320f909-41", "ovs_interfaceid": "a320f909-4120-4240-816d-9a98fd363e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "address": "fa:16:3e:a8:11:d0", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7d0a64-f5", "ovs_interfaceid": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "address": "fa:16:3e:e3:c3:ae", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0eef10-c9", "ovs_interfaceid": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "address": "fa:16:3e:b7:f3:8b", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf898b240-5e", "ovs_interfaceid": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "address": "fa:16:3e:80:4c:19", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap185ebfc4-a0", "ovs_interfaceid": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "address": "fa:16:3e:23:58:90", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3239f51b-2b", "ovs_interfaceid": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58487093-6f51-4a4b-968a-82b38b604734", "address": "fa:16:3e:60:04:19", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58487093-6f", "ovs_interfaceid": "58487093-6f51-4a4b-968a-82b38b604734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448801.016056) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:06:41.019713 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:06:41.020553 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:06:41.023358 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:06:41.023690 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:06:41.024491 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:06:41.024909 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:06:41.024909 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:06:41.025041 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:06:41.026231 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:06:41.027339 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:06:41.027490 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:06:41.027620 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:06:41.027720 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:06:41.027841 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:06:41.027947 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:06:41.028059 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:06:41.044969 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:41.048535 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:06:41.049092 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:41.049823 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:41.049987 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Cannot resize image /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:06:41.050970 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:06:41.051127 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Ensure instance console log exists: /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:06:41.051563 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:41.053195 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:41.053591 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:06:41.053931 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:41.054117 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:41.064607 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:41.064896 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:41.065182 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:41.065747 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:41.068533 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:41.068533 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:41.076618 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:41.076618 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:41.084196 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:41.084196 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:41.093771 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7] added Jun 03 01:06:41.093771 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:41.093771 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:41.093771 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:41.093771 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:41.093771 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:41.093771 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:41.093771 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:41.093771 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:41.093771 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:41.099424 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7] added Jun 03 01:06:41.099424 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:41.099424 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:41.099424 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:41.099424 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:41.099424 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:41.099424 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:41.099424 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:41.099424 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:41.099424 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:41.285507 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:41.479087 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-41f2ff58-a68e-40f3-b3d8-4ae9ce5c956b tempest-AttachSCSIVolumeTestJSON-1913972656 tempest-AttachSCSIVolumeTestJSON-1913972656-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:41.479087 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Removed pending STOPPED event for 1225d1ad-70c5-43e1-b8f0-927efb3ef6be due to new event Started> {{(pid=98288) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 03 01:06:41.479087 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:06:41.479087 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:41.490367 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] VM Started (Lifecycle Event) Jun 03 01:06:41.493194 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Instance running successfully. Jun 03 01:06:41.495780 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] finish_revert_migration finished successfully. {{(pid=98288) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}} Jun 03 01:06:41.509102 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-32be8ec1-ec0c-4bc2-acb2-fbf443076f75 req-ffb1110a-fd78-4076-85cd-06828e1f3155 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:41.615827 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:06:41.772965 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:41.912009 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Updating instance_info_cache with network_info: [{"id": "832eebb3-1a18-433e-8480-9be9f07a10f3", "address": "fa:16:3e:25:b7:2e", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap832eebb3-1a", "ovs_interfaceid": "832eebb3-1a18-433e-8480-9be9f07a10f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:41.920016 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-32be8ec1-ec0c-4bc2-acb2-fbf443076f75 req-ffb1110a-fd78-4076-85cd-06828e1f3155 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:41.994311 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:41.999484 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:42.032960 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "02e31daf-9f87-4574-be4b-3ed12bd8f050" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:42.033130 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:42.063346 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-32be8ec1-ec0c-4bc2-acb2-fbf443076f75 req-ffb1110a-fd78-4076-85cd-06828e1f3155 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updated VIF entry in instance network info cache for port 58487093-6f51-4a4b-968a-82b38b604734. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:06:42.063820 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-32be8ec1-ec0c-4bc2-acb2-fbf443076f75 req-ffb1110a-fd78-4076-85cd-06828e1f3155 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updating instance_info_cache with network_info: [{"id": "a320f909-4120-4240-816d-9a98fd363e9a", "address": "fa:16:3e:51:07:53", "network": {"id": "d10ab19a-aab5-4e75-a74f-de7b6c54ff1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1300013310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa320f909-41", "ovs_interfaceid": "a320f909-4120-4240-816d-9a98fd363e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "address": "fa:16:3e:a8:11:d0", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7d0a64-f5", "ovs_interfaceid": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "address": "fa:16:3e:e3:c3:ae", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0eef10-c9", "ovs_interfaceid": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "address": "fa:16:3e:b7:f3:8b", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf898b240-5e", "ovs_interfaceid": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "address": "fa:16:3e:80:4c:19", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap185ebfc4-a0", "ovs_interfaceid": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "address": "fa:16:3e:23:58:90", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3239f51b-2b", "ovs_interfaceid": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58487093-6f51-4a4b-968a-82b38b604734", "address": "fa:16:3e:60:04:19", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58487093-6f", "ovs_interfaceid": "58487093-6f51-4a4b-968a-82b38b604734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:42.093891 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:42.100116 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:42.106547 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:42.116022 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:42.123201 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:42.128355 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:42.140711 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.140711 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.140711 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.140711 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.140711 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.140711 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.140711 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:42.141571 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.141571 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.141571 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.141571 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.141571 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.141571 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.141571 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:42.141722 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.141722 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.141722 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.141722 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.141722 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.141722 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.141722 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:42.142069 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.142069 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.142069 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.142069 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.142069 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.142069 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.142069 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:42.179832 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7, portal: 192.168.50.100,3260] Jun 03 01:06:42.179832 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7, portal: 192.168.50.100,3260] successful. Jun 03 01:06:42.179832 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:42.184288 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7, portal: 192.168.40.100,3260] Jun 03 01:06:42.184288 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7, portal: 192.168.40.100,3260] successful. Jun 03 01:06:42.184288 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:42.192819 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:42.196231 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:42.207402 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.207402 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.207402 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.207402 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.207402 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:42.207402 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:42.207402 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.207402 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.207402 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:42.207621 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.207621 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.207621 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.207621 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.207621 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:42.207621 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:42.207621 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.207621 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.207621 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:42.207847 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:42.207904 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:42.209558 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] HCTL ('13', '-', '-', 0) found on session 23 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:42.209800 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:42.215633 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:42.217311 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:42.217311 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] HCTL ('14', '-', '-', 0) found on session 24 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:42.217311 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:42.230702 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Searching for a device in session 23 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:42.230702 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:42.232027 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Searching for a device in session 24 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:42.232027 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:42.414429 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Releasing lock "refresh_cache-d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:42.414841 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Instance network_info: |[{"id": "832eebb3-1a18-433e-8480-9be9f07a10f3", "address": "fa:16:3e:25:b7:2e", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap832eebb3-1a", "ovs_interfaceid": "832eebb3-1a18-433e-8480-9be9f07a10f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:06:42.417110 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Start _get_guest_xml network_info=[{"id": "832eebb3-1a18-433e-8480-9be9f07a10f3", "address": "fa:16:3e:25:b7:2e", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap832eebb3-1a", "ovs_interfaceid": "832eebb3-1a18-433e-8480-9be9f07a10f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:06:42.421808 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:06:42.422297 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-88756962', uuid='d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa'), owner=OwnerMeta(userid='4586ad9e4c304b0fa9a960267667ac64', username='tempest-AttachVolumeNegativeTest-1145310491-project-member', projectid='88e01380196548bbbe8f5f9e9147494b', projectname='tempest-AttachVolumeNegativeTest-1145310491'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "832eebb3-1a18-433e-8480-9be9f07a10f3", "address": "fa:16:3e:25:b7:2e", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap832eebb3-1a", "ovs_interfaceid": "832eebb3-1a18-433e-8480-9be9f07a10f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448802.4219139) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:06:42.426835 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:06:42.427644 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:06:42.431377 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:06:42.431683 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:06:42.433488 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:06:42.433488 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:06:42.433488 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:06:42.433488 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:06:42.433790 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:06:42.433843 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:06:42.433959 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:06:42.434149 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:06:42.434348 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:06:42.434613 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:06:42.434884 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:06:42.435098 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:06:42.456296 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-88756962',display_name='tempest-AttachVolumeNegativeTest-server-88756962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-attachvolumenegativetest-server-88756962',id=16,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqwEG1wE/LYUqJqqX9xCuGSOA92DqW+UrQXj2OK/5LvrGPc0KfwffJHdw+5DY2u6scKuYb8VqJjBDg2Ja02RXCnesb0BW/pFJnnKEORaoSZ/YCnkWgGriD6aCYoZXykUQ==',key_name='tempest-keypair-2085416467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e01380196548bbbe8f5f9e9147494b',ramdisk_id='',reservation_id='r-ii3x0nrx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1145310491',owner_user_name='tempest-AttachVolumeNegativeTest-1145310491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4586ad9e4c304b0fa9a960267667ac64',uuid=d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "832eebb3-1a18-433e-8480-9be9f07a10f3", "address": "fa:16:3e:25:b7:2e", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap832eebb3-1a", "ovs_interfaceid": "832eebb3-1a18-433e-8480-9be9f07a10f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:42.456541 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converting VIF {"id": "832eebb3-1a18-433e-8480-9be9f07a10f3", "address": "fa:16:3e:25:b7:2e", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap832eebb3-1a", "ovs_interfaceid": "832eebb3-1a18-433e-8480-9be9f07a10f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:42.457181 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=832eebb3-1a18-433e-8480-9be9f07a10f3,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832eebb3-1a') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:42.457741 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lazy-loading 'pci_devices' on Instance uuid d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:42.501977 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] During sync_power_state the instance has a pending task (resize_reverting). Skip. Jun 03 01:06:42.502347 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:42.502508 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] VM Paused (Lifecycle Event) Jun 03 01:06:42.535500 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:06:42.566403 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-32be8ec1-ec0c-4bc2-acb2-fbf443076f75 req-ffb1110a-fd78-4076-85cd-06828e1f3155 service nova] Releasing lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:42.574137 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-cfa54758-2d16-4c76-88c1-217914cc4c1a tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updating instance to original state: 'active' Jun 03 01:06:42.866237 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:42.880801 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c50f1b66-6c18-4c8f-ae7d-54d41d3a124f req-42c300ae-4ebf-4b4e-b296-3da6aa818f80 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:42.881220 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c50f1b66-6c18-4c8f-ae7d-54d41d3a124f req-42c300ae-4ebf-4b4e-b296-3da6aa818f80 service nova] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:42.881586 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c50f1b66-6c18-4c8f-ae7d-54d41d3a124f req-42c300ae-4ebf-4b4e-b296-3da6aa818f80 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:42.881586 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c50f1b66-6c18-4c8f-ae7d-54d41d3a124f req-42c300ae-4ebf-4b4e-b296-3da6aa818f80 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:42.881586 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c50f1b66-6c18-4c8f-ae7d-54d41d3a124f req-42c300ae-4ebf-4b4e-b296-3da6aa818f80 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] No waiting events found dispatching network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:42.881724 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-c50f1b66-6c18-4c8f-ae7d-54d41d3a124f req-42c300ae-4ebf-4b4e-b296-3da6aa818f80 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received unexpected event network-vif-plugged-9055a094-dc81-45da-9637-48b820c58772 for instance with vm_state active and task_state None. Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] End _get_guest_xml xml= Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: instance-00000010 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: 196608 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: tempest-AttachVolumeNegativeTest-server-88756962 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: 2026-06-03 01:06:42 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: 192 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: True Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: bare Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: tempest-AttachVolumeNegativeTest-1145310491-project-member Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: tempest-AttachVolumeNegativeTest-1145310491 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: hvm Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: 128 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: Jun 03 01:06:42.960902 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:06:42.962654 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Preparing to wait for external event network-vif-plugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:42.962654 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:42.962654 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:42.962654 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:42.962654 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-88756962',display_name='tempest-AttachVolumeNegativeTest-server-88756962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-attachvolumenegativetest-server-88756962',id=16,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqwEG1wE/LYUqJqqX9xCuGSOA92DqW+UrQXj2OK/5LvrGPc0KfwffJHdw+5DY2u6scKuYb8VqJjBDg2Ja02RXCnesb0BW/pFJnnKEORaoSZ/YCnkWgGriD6aCYoZXykUQ==',key_name='tempest-keypair-2085416467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e01380196548bbbe8f5f9e9147494b',ramdisk_id='',reservation_id='r-ii3x0nrx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1145310491',owner_user_name='tempest-AttachVolumeNegativeTest-1145310491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4586ad9e4c304b0fa9a960267667ac64',uuid=d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "832eebb3-1a18-433e-8480-9be9f07a10f3", "address": "fa:16:3e:25:b7:2e", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap832eebb3-1a", "ovs_interfaceid": "832eebb3-1a18-433e-8480-9be9f07a10f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:42.962654 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converting VIF {"id": "832eebb3-1a18-433e-8480-9be9f07a10f3", "address": "fa:16:3e:25:b7:2e", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap832eebb3-1a", "ovs_interfaceid": "832eebb3-1a18-433e-8480-9be9f07a10f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:42.963385 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=832eebb3-1a18-433e-8480-9be9f07a10f3,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832eebb3-1a') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:42.963666 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=832eebb3-1a18-433e-8480-9be9f07a10f3,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832eebb3-1a') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:42.964068 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:42.964319 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:42.964555 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:42.965698 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:42.965859 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7609daf-8b54-5eb6-9a4c-8fb71fb2a840', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:42.966816 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:42.967458 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:42.968091 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:42.970107 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:42.970260 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap832eebb3-1a, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:42.970625 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap832eebb3-1a, col_values=(('qos', UUID('efb34b46-8b4e-432f-8489-c42c64143ef0')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:42.970979 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap832eebb3-1a, col_values=(('external_ids', {'iface-id': '832eebb3-1a18-433e-8480-9be9f07a10f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:b7:2e', 'vm-uuid': 'd6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:42.971971 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:42.973538 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:42.977611 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:42.978099 np0000002000 nova-compute[98288]: INFO os_vif [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=832eebb3-1a18-433e-8480-9be9f07a10f3,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832eebb3-1a') Jun 03 01:06:43.005007 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:43.006515 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:43.006656 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] VM Resumed (Lifecycle Event) Jun 03 01:06:43.066876 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:06:43.101893 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:43.101893 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:43.107436 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:06:43.107564 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Claim successful on node np0000002000 Jun 03 01:06:43.511128 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:43.512857 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:43.644156 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:44.060920 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0018277639999269013 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:44.061637 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:44.061793 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:44.062003 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] VM Stopped (Lifecycle Event) Jun 03 01:06:44.063219 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.016793216999985816 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:44.063508 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.016654714999958742 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:44.080290 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0002968549999877723 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:44.080727 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:44.080727 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:44.082007 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] VM Stopped (Lifecycle Event) Jun 03 01:06:44.083433 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Found WWN 330000000a8e9a161 for multipath device dm-3 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:06:44.083733 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:44.083883 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000a8e9a161', 'path': '/dev/dm-3', 'multipath_id': '330000000a8e9a161'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:44.083992 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a8e9a161', 'path': '/dev/dm-3', 'multipath_id': '330000000a8e9a161'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:06:44.493119 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:44.493264 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:44.493404 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:44.493593 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:44.493717 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:44.497885 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Terminating instance Jun 03 01:06:44.505635 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:44.505635 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:44.505635 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] No VIF found with MAC fa:16:3e:25:b7:2e, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:06:44.505635 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Using config drive Jun 03 01:06:44.565360 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: f448afac-6687-4a4a-84ff-b4478c316986] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:44.584906 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 2bb3c4d2-34d9-4bd8-ac8d-b119036d31a5] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:44.589568 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:06:44.589829 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f21eee2a-ec1f-4025-94ec-0b807c046f78', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:44.590018 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:44.590523 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:44.590769 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f21eee2a-ec1f-4025-94ec-0b807c046f78', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:06:44.604842 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:44.605296 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:44.605718 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:44.605967 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:44.610472 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:44.610472 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:44.620476 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:44.620476 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:44.621782 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:44.621782 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:44.636156 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78] added Jun 03 01:06:44.636156 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:44.636156 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:44.636156 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:44.636156 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:44.636156 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:44.636156 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:44.636352 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:44.636463 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:44.636568 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:44.640848 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78] added Jun 03 01:06:44.640848 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:44.640848 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:44.640848 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:44.640848 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:44.640848 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:44.640848 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:44.641068 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:44.642922 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:44.642922 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:44.751470 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:06:44.751470 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:06:45.001379 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:06:45.012831 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:45.053160 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:45.073981 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:45.080032 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:45.109802 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:45.183612 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Creating config drive at /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk.config Jun 03 01:06:45.189414 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf5e97jr6 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:45.233163 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf5e97jr6" returned: 0 in 0.043s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:45.255065 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:06:45.267122 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2ece6a9e-5d20-45d1-b635-7b6fda3931dd req-b7fb72cd-9bbd-43ac-bd8d-74f6ee87cdb9 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:45.267781 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2ece6a9e-5d20-45d1-b635-7b6fda3931dd req-b7fb72cd-9bbd-43ac-bd8d-74f6ee87cdb9 service nova] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:45.267781 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2ece6a9e-5d20-45d1-b635-7b6fda3931dd req-b7fb72cd-9bbd-43ac-bd8d-74f6ee87cdb9 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:45.267781 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2ece6a9e-5d20-45d1-b635-7b6fda3931dd req-b7fb72cd-9bbd-43ac-bd8d-74f6ee87cdb9 service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:45.268475 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2ece6a9e-5d20-45d1-b635-7b6fda3931dd req-b7fb72cd-9bbd-43ac-bd8d-74f6ee87cdb9 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] No waiting events found dispatching network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:45.268475 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2ece6a9e-5d20-45d1-b635-7b6fda3931dd req-b7fb72cd-9bbd-43ac-bd8d-74f6ee87cdb9 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:06:45.411642 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999665561000029 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:45.412015 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999290058000042 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:45.412130 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.99914225800012 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:45.413663 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Instance destroyed successfully. Jun 03 01:06:45.414380 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lazy-loading 'resources' on Instance uuid 1225d1ad-70c5-43e1-b8f0-927efb3ef6be {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:45.560504 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Rebuilding instance Jun 03 01:06:45.599786 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:45.637016 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:45.642828 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:45.655971 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:45.668599 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:45.672108 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:45.681071 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:45.691061 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.691061 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.691061 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.691061 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.691061 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.691061 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.691061 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.691061 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.691061 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:45.691228 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.691228 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.691228 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.691228 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.691228 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.691228 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.691228 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.691228 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.691228 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:45.701072 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.701072 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.701072 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.701072 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.701072 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.701072 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.701072 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.701072 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.701072 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:45.702499 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.702499 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.702499 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.702499 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.702499 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.702499 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.702499 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.702499 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.702499 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:45.707640 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:45.734714 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78, portal: 192.168.40.100,3260] Jun 03 01:06:45.734714 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78, portal: 192.168.40.100,3260] successful. Jun 03 01:06:45.734714 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:45.746203 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:45.758625 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78, portal: 192.168.50.100,3260] Jun 03 01:06:45.758625 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78, portal: 192.168.50.100,3260] successful. Jun 03 01:06:45.758625 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:45.766925 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:45.772886 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.668s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:45.772886 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:06:45.775575 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.775575 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.775575 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.775575 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.775575 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.775575 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.775575 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:45.775575 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:45.775575 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.775575 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.775575 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:45.776721 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:45.777057 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.777057 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.777057 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.777057 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.777057 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.777057 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.777057 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:45.777057 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:45.777057 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.777057 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.777057 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:45.778982 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:45.778982 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:45.779687 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] HCTL ('15', '-', '-', 0) found on session 25 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:45.780434 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:45.796655 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Searching for a device in session 25 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f21eee2a-ec1f-4025-94ec-0b807c046f78', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:45.803719 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:45.805062 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:45.805062 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] HCTL ('16', '-', '-', 0) found on session 26 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:45.805062 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:45.823257 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Searching for a device in session 26 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:45.823257 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f21eee2a-ec1f-4025-94ec-0b807c046f78', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:45.905318 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:45.920798 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-690499922',display_name='tempest-ServerActionsTestOtherB-server-690499922',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serveractionstestotherb-server-690499922',id=3,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+EmDDwoR2OvmMWSLRL3pD12IuhLKXYlFCyFD0S6tz1U811/Ppz6LfRqvK84OL/tJp7AFM3OOYK27W8pAe9Ufj1wNI9CICCs+j8JCdUBCkwgtBDQJU6o6T6RKxEkHfeyw==',key_name='tempest-keypair-122608129',keypairs=,launch_index=0,launched_at=2026-06-03T01:06:42Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='64016d71af32442f8c9e0e2fc40a542b',ramdisk_id='',reservation_id='r-mvqoecge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1369156437',owner_user_name='tempest-ServerActionsTestOtherB-1369156437-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a95a67614fa2443596fde71d819153e7',uuid=1225d1ad-70c5-43e1-b8f0-927efb3ef6be,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:06:45.921148 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converting VIF {"id": "9055a094-dc81-45da-9637-48b820c58772", "address": "fa:16:3e:ee:15:36", "network": {"id": "9fdc0c48-01a6-4930-b628-5ca24c9918b9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1936602961-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "64016d71af32442f8c9e0e2fc40a542b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9055a094-dc", "ovs_interfaceid": "9055a094-dc81-45da-9637-48b820c58772", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:45.921973 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:45.922479 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:06:45.924983 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:45.925975 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9055a094-dc, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:45.928019 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:45.929196 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:45.929971 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:45.930158 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2aa654f-f4d7-43d0-bcdc-5137b14db78c) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:45.930680 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:45.931181 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:45.932185 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:45.934799 np0000002000 nova-compute[98288]: INFO os_vif [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:15:36,bridge_name='br-int',has_traffic_filtering=True,id=9055a094-dc81-45da-9637-48b820c58772,network=Network(9fdc0c48-01a6-4930-b628-5ca24c9918b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9055a094-dc') Jun 03 01:06:45.938254 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:06:45.938643 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:45.938841 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:46.126560 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-cb18cdd2-62a3-49ad-81be-3ff74899f4b8 req-2fbcee7a-7811-4df4-9fb9-648def626083 service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-vif-plugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:46.127312 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-cb18cdd2-62a3-49ad-81be-3ff74899f4b8 req-2fbcee7a-7811-4df4-9fb9-648def626083 service nova] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:46.127312 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-cb18cdd2-62a3-49ad-81be-3ff74899f4b8 req-2fbcee7a-7811-4df4-9fb9-648def626083 service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:46.127549 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-cb18cdd2-62a3-49ad-81be-3ff74899f4b8 req-2fbcee7a-7811-4df4-9fb9-648def626083 service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:46.127643 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-cb18cdd2-62a3-49ad-81be-3ff74899f4b8 req-2fbcee7a-7811-4df4-9fb9-648def626083 service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Processing event network-vif-plugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:06:46.159310 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:46.161277 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:46.164899 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:46.185778 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:46.186610 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:46.278731 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:06:46.278921 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:06:46.279364 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:46.280236 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:46.389968 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a5f52b75bd44cd880fcd26870d24190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b5c165c8b142b6af1c20eeac918eb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:06:46.606423 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:06:46.661214 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:06:46.662432 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:46.662618 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] VM Started (Lifecycle Event) Jun 03 01:06:46.668131 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:06:46.675851 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Instance spawned successfully. Jun 03 01:06:46.677896 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:06:46.735790 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:46.739434 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:46.759323 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:46.765534 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:46.781024 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:06:46.790908 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:46.851721 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Successfully created port: d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:06:47.024252 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:47.030115 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d67dcc83-a8e9-4fe5-bd00-103a21003d0a req-67c77184-c763-4196-ae09-f33577d52057 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event network-vif-unplugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:47.030798 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d67dcc83-a8e9-4fe5-bd00-103a21003d0a req-67c77184-c763-4196-ae09-f33577d52057 service nova] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:47.030993 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d67dcc83-a8e9-4fe5-bd00-103a21003d0a req-67c77184-c763-4196-ae09-f33577d52057 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:47.031096 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d67dcc83-a8e9-4fe5-bd00-103a21003d0a req-67c77184-c763-4196-ae09-f33577d52057 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:47.031239 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d67dcc83-a8e9-4fe5-bd00-103a21003d0a req-67c77184-c763-4196-ae09-f33577d52057 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] No waiting events found dispatching network-vif-unplugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:47.032024 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-d67dcc83-a8e9-4fe5-bd00-103a21003d0a req-67c77184-c763-4196-ae09-f33577d52057 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received unexpected event network-vif-unplugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f for instance with vm_state active and task_state rebuilding. Jun 03 01:06:47.034820 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:47.051738 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Instance destroyed successfully. Jun 03 01:06:47.057433 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Instance destroyed successfully. Jun 03 01:06:47.058548 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1297217656',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serveractionsv293testjson-server-1203236219',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOg/hEenxdNX4Z4QcNELt5stRwXZTqpWqT/PnVuKXCyR5nUlt1GylsaLK+alFPxegCcwDcE1qtmOZmRjXIw2iSsxnqNGSTWidkIuhnCdIaEbbKV6LWajW9bpcLx4K00nA==',key_name='tempest-keypair-2103291389',keypairs=,launch_index=0,launched_at=2026-06-03T01:06:05Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ae2da6faf29d4db18ccfc9a42a93ab7d',ramdisk_id='',reservation_id='r-1quzjl2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d525a532-1643-48cd-87e8-a667d774c5cf',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-378692121',owner_user_name='tempest-ServerActionsV293TestJSON-378692121-project-member'},tags=,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5200a7ff60b4b65812c39efec311990',uuid=fd0a3a08-1a8c-482c-836a-19ac700c473f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:06:47.060830 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Converting VIF {"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:47.060830 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:47.060830 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:06:47.063871 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:47.064070 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4966a48-96, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:47.066810 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:47.068380 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:47.070423 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:47.070423 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d856a3d-93f6-400b-abeb-337e1f683761) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:47.074694 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:47.079558 np0000002000 nova-compute[98288]: INFO os_vif [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') Jun 03 01:06:47.081587 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:06:47.081587 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:47.082459 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:47.164949 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:47.172565 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:47.189079 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:47.189663 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:47.189932 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:47.190212 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:47.190645 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:47.190976 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:06:47.282690 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:06:47.347777 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-502f8796-327b-4532-85e6-b8d1819e5671 req-bceeb20c-93c1-4bd1-b7ce-584551ed2ecc service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:47.347988 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-502f8796-327b-4532-85e6-b8d1819e5671 req-bceeb20c-93c1-4bd1-b7ce-584551ed2ecc service nova] Acquiring lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:47.348187 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-502f8796-327b-4532-85e6-b8d1819e5671 req-bceeb20c-93c1-4bd1-b7ce-584551ed2ecc service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:47.348319 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-502f8796-327b-4532-85e6-b8d1819e5671 req-bceeb20c-93c1-4bd1-b7ce-584551ed2ecc service nova] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:47.348676 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-502f8796-327b-4532-85e6-b8d1819e5671 req-bceeb20c-93c1-4bd1-b7ce-584551ed2ecc service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] No waiting events found dispatching network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:47.348806 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-502f8796-327b-4532-85e6-b8d1819e5671 req-bceeb20c-93c1-4bd1-b7ce-584551ed2ecc service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-unplugged-9055a094-dc81-45da-9637-48b820c58772 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:06:47.445714 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Successfully updated port: d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:06:47.626608 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Found WWN 3300000006e861b98 for multipath device dm-6 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:06:47.626863 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:47.627036 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000006e861b98', 'path': '/dev/dm-6', 'multipath_id': '3300000006e861b98'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:47.627153 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006e861b98', 'path': '/dev/dm-6', 'multipath_id': '3300000006e861b98'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:06:47.630245 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.691s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:47.630867 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0782cb8d-527b-47ac-898d-a53b667d4af1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:06:47.631021 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:06:47.665005 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:47.665005 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:47.665005 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:47.665005 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:47.665005 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:47.665005 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:47.665005 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:47.665005 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:47.665005 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:47.665005 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:47.665005 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:47.665330 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:47.665330 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:47.665330 np0000002000 nova-compute[98288]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:47.665330 np0000002000 nova-compute[98288]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1 (non-flash) Jun 03 01:06:47.665330 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:47.665330 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:47.665330 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:47.665330 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:47.665330 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:47.665330 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:47.665330 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:47.665684 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:06:47.665684 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '21')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:47.666902 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1', '22')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:47.668077 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Resulting device map defaultdict(. at 0x73e7b80a2e80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'): ({'sdg'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:06:47.668308 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Removing multipathed devices sdf, sdg {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:06:47.669270 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Flush multipath device 3300000004792dc3e {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:06:47.674824 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:06:47.674984 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:47.675261 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] VM Paused (Lifecycle Event) Jun 03 01:06:47.698134 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Took 7.13 seconds to spawn the instance on the hypervisor. Jun 03 01:06:47.698296 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:47.705891 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:06:47.759494 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:06:47.789868 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Booting with volume-backed-image 19d2b67c-d393-46ed-9253-ee20621e0ff0 at /dev/vda Jun 03 01:06:47.809831 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:06:47.810116 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:06:47.813639 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:06:47.824312 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:06:47.824529 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:06:47.836901 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:47.867726 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:47.876631 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.40.100,3260] Jun 03 01:06:47.876631 np0000002000 nova-compute[98288]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.40.100,3260] successful. Jun 03 01:06:47.876631 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:47.895053 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:47.907036 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:47.939724 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.50.100,3260] Jun 03 01:06:47.939724 np0000002000 nova-compute[98288]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-0782cb8d-527b-47ac-898d-a53b667d4af1, portal: 192.168.50.100,3260] successful. Jun 03 01:06:47.939724 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:47.951172 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "refresh_cache-02e31daf-9f87-4574-be4b-3ed12bd8f050" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:47.951271 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquired lock "refresh_cache-02e31daf-9f87-4574-be4b-3ed12bd8f050" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:47.951396 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:06:47.961563 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:47.962564 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:47.962757 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] <== disconnect_volume: return (2024ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:47.963019 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:06:47.963741 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.881s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:47.964057 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:06:47.964247 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:06:47.965129 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Deleting instance files /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be_del Jun 03 01:06:47.972987 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Deletion of /opt/stack/data/nova/instances/1225d1ad-70c5-43e1-b8f0-927efb3ef6be_del complete Jun 03 01:06:47.993808 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:47.993808 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:47.993808 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:47.993808 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:47.993808 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:47.993808 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:47.993808 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:47.993808 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:47.993808 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:47.994876 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsi session list stdout=tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:47.994876 np0000002000 nova-compute[98288]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:06:47.994876 np0000002000 nova-compute[98288]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:47.994876 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:47.994876 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:47.994876 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:47.994876 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:47.994876 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:47.994876 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:47.994876 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:06:47.994876 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '15')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:47.995263 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '16')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:47.997153 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Resulting device map defaultdict(. at 0x73e794728860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'): ({'sdd'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:06:47.997153 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Removing multipathed devices sdd, sde {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:06:47.997153 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Flush multipath device 330000000ddb5455d {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:06:48.050517 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:06:48.087633 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:06:48.130935 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:06:48.131213 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:48.131358 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:48.135019 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:06:48.135203 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:06:48.136265 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:06:48.151843 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:06:48.151929 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:06:48.163022 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:48.178091 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:48.179607 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:48.179732 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] VM Resumed (Lifecycle Event) Jun 03 01:06:48.198961 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.40.100,3260] Jun 03 01:06:48.198961 np0000002000 nova-compute[98288]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.40.100,3260] successful. Jun 03 01:06:48.198961 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:48.207149 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Took 15.05 seconds to build instance. Jun 03 01:06:48.216267 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-44b32de4-f8e8-438b-8398-94fe1b73caf8 req-d4db25a6-f100-4632-9544-4a354a83a372 service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-vif-plugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:48.216267 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-44b32de4-f8e8-438b-8398-94fe1b73caf8 req-d4db25a6-f100-4632-9544-4a354a83a372 service nova] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:48.218282 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-44b32de4-f8e8-438b-8398-94fe1b73caf8 req-d4db25a6-f100-4632-9544-4a354a83a372 service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:48.218948 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-44b32de4-f8e8-438b-8398-94fe1b73caf8 req-d4db25a6-f100-4632-9544-4a354a83a372 service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:48.219268 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-44b32de4-f8e8-438b-8398-94fe1b73caf8 req-d4db25a6-f100-4632-9544-4a354a83a372 service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] No waiting events found dispatching network-vif-plugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:48.219745 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:48.220079 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-44b32de4-f8e8-438b-8398-94fe1b73caf8 req-d4db25a6-f100-4632-9544-4a354a83a372 service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received unexpected event network-vif-plugged-832eebb3-1a18-433e-8480-9be9f07a10f3 for instance with vm_state active and task_state None. Jun 03 01:06:48.235626 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:48.270237 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.50.100,3260] Jun 03 01:06:48.270237 np0000002000 nova-compute[98288]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.50.100,3260] successful. Jun 03 01:06:48.270237 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:48.286456 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:48.286770 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:48.287038 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] <== disconnect_volume: return (1204ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:48.287300 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:06:48.287721 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.156s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:48.287952 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:06:48.288594 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Deleting instance files /opt/stack/data/nova/instances/fd0a3a08-1a8c-482c-836a-19ac700c473f_del Jun 03 01:06:48.291666 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Deletion of /opt/stack/data/nova/instances/fd0a3a08-1a8c-482c-836a-19ac700c473f_del complete Jun 03 01:06:48.299770 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:48.300326 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:48.302064 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:48.302272 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:48.302684 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:48.302943 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:48.317982 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:48.317982 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:48.324963 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:48.324963 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:48.337187 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df] added Jun 03 01:06:48.337187 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:48.337187 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:48.337187 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:48.337187 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:48.337187 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:48.337187 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:48.337187 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:48.337187 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0342(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:48.337187 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:48.346267 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df] added Jun 03 01:06:48.346267 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:48.346267 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:48.346267 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:48.346267 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:48.346267 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:48.346267 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:48.346548 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:48.346743 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0438(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:48.346897 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:48.482628 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Took 3.48 seconds to destroy the instance on the hypervisor. Jun 03 01:06:48.483118 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:06:48.483326 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:06:48.483419 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:06:48.483668 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:48.602583 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:06:48.682797 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:48.686005 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:48.708810 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.564s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:48.710786 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:48.895111 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance fd0a3a08-1a8c-482c-836a-19ac700c473f could not be found. Jun 03 01:06:48.896032 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:06:48.896106 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:48.896215 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:49.089889 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event network-vif-unplugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:49.090003 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:49.090181 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:49.090253 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:49.090342 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] No waiting events found dispatching network-vif-unplugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:49.090472 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received unexpected event network-vif-unplugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f for instance with vm_state active and task_state rebuilding. Jun 03 01:06:49.090601 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received event network-vif-unplugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:49.092012 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] Acquiring lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:49.092012 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:49.092012 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:49.092611 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] No waiting events found dispatching network-vif-unplugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:06:49.092723 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received unexpected event network-vif-unplugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 for instance with vm_state building and task_state block_device_mapping. Jun 03 01:06:49.092843 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-changed-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:49.092980 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Refreshing instance network info cache due to event network-changed-832eebb3-1a18-433e-8480-9be9f07a10f3. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:49.093093 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] Acquiring lock "refresh_cache-d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:49.093179 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] Acquired lock "refresh_cache-d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:49.093283 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Refreshing network info cache for port 832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:49.110383 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:49.189288 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999777774999984 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:06:49.279614 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Updating instance_info_cache with network_info: [{"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:49.337100 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:49.347579 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:49.351183 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:49.357080 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:49.362014 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:49.373025 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.373025 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.373025 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.373025 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.373025 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.373025 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.373025 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:49.373361 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.373361 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.373361 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.373361 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.373361 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.373361 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.373361 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:49.378577 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:49.396942 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.396942 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.396942 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.396942 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.396942 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.396942 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.396942 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:49.397133 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.397133 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.397133 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.397133 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.397133 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.397133 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.397133 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:49.410086 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df, portal: 192.168.40.100,3260] Jun 03 01:06:49.410086 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df, portal: 192.168.40.100,3260] successful. Jun 03 01:06:49.410086 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:49.420709 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:49.435067 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-95ace9ca-8f78-4ead-994a-c40eaaacf8da req-c227e0a6-18d9-4dc0-8ee9-567574b22b12 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received event network-changed-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:49.435067 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-95ace9ca-8f78-4ead-994a-c40eaaacf8da req-c227e0a6-18d9-4dc0-8ee9-567574b22b12 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Refreshing instance network info cache due to event network-changed-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:06:49.435897 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-95ace9ca-8f78-4ead-994a-c40eaaacf8da req-c227e0a6-18d9-4dc0-8ee9-567574b22b12 service nova] Acquiring lock "refresh_cache-02e31daf-9f87-4574-be4b-3ed12bd8f050" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:06:49.445097 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df, portal: 192.168.50.100,3260] Jun 03 01:06:49.445097 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df, portal: 192.168.50.100,3260] successful. Jun 03 01:06:49.445097 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:49.451359 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.451359 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.451359 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.451359 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.451359 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:49.451359 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:49.451359 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.451359 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.451359 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:49.451666 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.451666 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.451666 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.451666 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.451666 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:49.451666 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:49.451666 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.451666 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.451666 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:49.451967 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:49.452052 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:49.452958 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] HCTL ('9', '-', '-', 0) found on session 27 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:49.453115 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:49.459557 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:49.466707 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Searching for a device in session 27 and hctl ['9', '*', '*', 0] yield: None {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:49.479691 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.479691 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.479691 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.479691 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.479691 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:49.479691 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:49.479691 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.479691 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.479691 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:49.479898 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.479898 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:49.479898 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.479898 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:49.479898 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:49.479898 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:49.479898 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.479898 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:49.479898 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:49.480182 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:49.480342 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:49.481210 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] HCTL ('10', '-', '-', 0) found on session 28 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:49.481341 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:49.500323 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Searching for a device in session 28 and hctl ['10', '*', '*', 0] yield: None {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:49.595994 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:49.781728 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Releasing lock "refresh_cache-02e31daf-9f87-4574-be4b-3ed12bd8f050" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:49.781981 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Instance network_info: |[{"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:06:49.782370 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-95ace9ca-8f78-4ead-994a-c40eaaacf8da req-c227e0a6-18d9-4dc0-8ee9-567574b22b12 service nova] Acquired lock "refresh_cache-02e31daf-9f87-4574-be4b-3ed12bd8f050" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:06:49.782592 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-95ace9ca-8f78-4ead-994a-c40eaaacf8da req-c227e0a6-18d9-4dc0-8ee9-567574b22b12 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Refreshing network info cache for port d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:06:49.908301 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:49.961128 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:50.092942 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Updated VIF entry in instance network info cache for port 832eebb3-1a18-433e-8480-9be9f07a10f3. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:06:50.093264 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Updating instance_info_cache with network_info: [{"id": "832eebb3-1a18-433e-8480-9be9f07a10f3", "address": "fa:16:3e:25:b7:2e", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap832eebb3-1a", "ovs_interfaceid": "832eebb3-1a18-433e-8480-9be9f07a10f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:50.284652 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-95ace9ca-8f78-4ead-994a-c40eaaacf8da req-c227e0a6-18d9-4dc0-8ee9-567574b22b12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:50.315816 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-ede1c2ce-a94f-408d-acba-c78e80242da7 req-741eb4eb-4e7a-427f-922e-235fe4f555b2 service nova] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Received event network-vif-deleted-9055a094-dc81-45da-9637-48b820c58772 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:50.463541 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Took 1.98 seconds to deallocate network for instance. Jun 03 01:06:50.469526 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:50.470205 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:50.473776 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Searching for a device in session 27 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:50.473954 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:50.499325 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Searching for a device in session 28 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:50.499602 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:50.595913 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-84bbff3f-5197-4151-bafa-a8ae351c9f07 req-465c321f-2b44-4d41-a65d-2fd3417d906b service nova] Releasing lock "refresh_cache-d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:50.601251 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-95ace9ca-8f78-4ead-994a-c40eaaacf8da req-c227e0a6-18d9-4dc0-8ee9-567574b22b12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:50.747365 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-95ace9ca-8f78-4ead-994a-c40eaaacf8da req-c227e0a6-18d9-4dc0-8ee9-567574b22b12 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Updated VIF entry in instance network info cache for port d2016ef2-49b4-4aa3-bdc8-f0bef07c6901. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:06:50.747696 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-95ace9ca-8f78-4ead-994a-c40eaaacf8da req-c227e0a6-18d9-4dc0-8ee9-567574b22b12 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Updating instance_info_cache with network_info: [{"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:06:50.753259 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:50.975023 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'flavor' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:51.024331 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Took 0.56 seconds to detach 1 volumes for instance. Jun 03 01:06:51.256678 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-95ace9ca-8f78-4ead-994a-c40eaaacf8da req-c227e0a6-18d9-4dc0-8ee9-567574b22b12 service nova] Releasing lock "refresh_cache-02e31daf-9f87-4574-be4b-3ed12bd8f050" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:06:51.303073 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:06:51.321901 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:51.331372 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:06:51.355041 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:51.390638 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:06:51.390992 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:06:51.401965 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:06:51.403345 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feb8:822', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fe29:1d7b', 'fe80::fc16:3eff:fe5e:4e78', 'fe80::fc16:3eff:fee5:47da', 'fe80::fc16:3eff:fe6f:53ec', 'fe80::fc16:3eff:fe25:b72e', 'fe80::3c0a:faff:fe92:9db2'] Jun 03 01:06:51.403514 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:06:51.403662 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:06:51.403948 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:51.404172 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Updating existing volume attachment record: b1f02c15-7ace-4492-8f7b-ca612460360f {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:06:51.532694 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:51.532694 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:51.534092 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:51.603460 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Deleted allocations for instance 1225d1ad-70c5-43e1-b8f0-927efb3ef6be Jun 03 01:06:51.987618 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.517s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:52.071933 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:52.321944 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:52.328784 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Found WWN 330000000fb9aebf6 for multipath device dm-1 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:06:52.329264 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.042s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:52.329856 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] <== connect_volume: return (4197ms) {'type': 'block', 'scsi_wwn': '330000000fb9aebf6', 'path': '/dev/dm-1', 'multipath_id': '330000000fb9aebf6'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:52.331319 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.434s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:52.332076 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fb9aebf6', 'path': '/dev/dm-1', 'multipath_id': '330000000fb9aebf6'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:06:52.332419 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:06:52.334189 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:06:52.368981 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:52.368981 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:52.368981 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:52.368981 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:52.368981 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:52.368981 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:52.368981 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:52.368981 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:52.368981 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:52.369368 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:52.369368 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:52.369368 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:52.369368 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:52.369368 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:52.369368 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:52.369368 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:52.369368 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:52.369368 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:52.369597 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:06:52.369663 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, 0): [] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:52.373039 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688') {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jun 03 01:06:52.373039 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, 0): [] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:06:52.373039 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688') {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jun 03 01:06:52.373039 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Resulting device map defaultdict(. at 0x73e794738360>, {}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:06:52.373039 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Disconnecting from: [] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:06:52.373262 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.043s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:52.373262 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] <== disconnect_volume: return (3476ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:52.373910 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:06:52.613411 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2a3f13e9-a3d2-49f4-b26a-ed037ed13795 tempest-ServerActionsTestOtherB-1369156437 tempest-ServerActionsTestOtherB-1369156437-project-member] Lock "1225d1ad-70c5-43e1-b8f0-927efb3ef6be" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.120s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:52.839946 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a320f909-4120-4240-816d-9a98fd363e9a", "address": "fa:16:3e:51:07:53", "network": {"id": "d10ab19a-aab5-4e75-a74f-de7b6c54ff1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1300013310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa320f909-41", "ovs_interfaceid": "a320f909-4120-4240-816d-9a98fd363e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:52.840135 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "a320f909-4120-4240-816d-9a98fd363e9a", "address": "fa:16:3e:51:07:53", "network": {"id": "d10ab19a-aab5-4e75-a74f-de7b6c54ff1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1300013310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa320f909-41", "ovs_interfaceid": "a320f909-4120-4240-816d-9a98fd363e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:52.840770 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:07:53,bridge_name='br-int',has_traffic_filtering=True,id=a320f909-4120-4240-816d-9a98fd363e9a,network=Network(d10ab19a-aab5-4e75-a74f-de7b6c54ff1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa320f909-41') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:52.841491 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "address": "fa:16:3e:a8:11:d0", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7d0a64-f5", "ovs_interfaceid": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:52.841630 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "address": "fa:16:3e:a8:11:d0", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7d0a64-f5", "ovs_interfaceid": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:52.843674 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:11:d0,bridge_name='br-int',has_traffic_filtering=True,id=ae7d0a64-f5a4-4d43-84ce-d5f781f0b036,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae7d0a64-f5') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:52.843674 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "address": "fa:16:3e:e3:c3:ae", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0eef10-c9", "ovs_interfaceid": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:52.843674 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "address": "fa:16:3e:e3:c3:ae", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0eef10-c9", "ovs_interfaceid": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:52.844041 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c3:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b0eef10-c9f6-488a-9800-6e7d807e7336,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b0eef10-c9') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:52.844975 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "address": "fa:16:3e:b7:f3:8b", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf898b240-5e", "ovs_interfaceid": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:52.845113 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "address": "fa:16:3e:b7:f3:8b", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf898b240-5e", "ovs_interfaceid": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:52.845763 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f3:8b,bridge_name='br-int',has_traffic_filtering=True,id=f898b240-5ec0-4735-90c6-f8aa562b0cac,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf898b240-5e') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:52.846457 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "address": "fa:16:3e:80:4c:19", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap185ebfc4-a0", "ovs_interfaceid": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:52.846652 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "address": "fa:16:3e:80:4c:19", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap185ebfc4-a0", "ovs_interfaceid": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:52.847024 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:4c:19,bridge_name='br-int',has_traffic_filtering=True,id=185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185ebfc4-a0') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:52.848428 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "address": "fa:16:3e:23:58:90", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3239f51b-2b", "ovs_interfaceid": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:52.848428 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "address": "fa:16:3e:23:58:90", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3239f51b-2b", "ovs_interfaceid": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:52.848428 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:58:90,bridge_name='br-int',has_traffic_filtering=True,id=3239f51b-2bbd-4d49-a354-7e0a6a03549a,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3239f51b-2b') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:52.848670 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58487093-6f51-4a4b-968a-82b38b604734", "address": "fa:16:3e:60:04:19", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58487093-6f", "ovs_interfaceid": "58487093-6f51-4a4b-968a-82b38b604734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:52.848844 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "58487093-6f51-4a4b-968a-82b38b604734", "address": "fa:16:3e:60:04:19", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58487093-6f", "ovs_interfaceid": "58487093-6f51-4a4b-968a-82b38b604734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:52.849088 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:04:19,bridge_name='br-int',has_traffic_filtering=True,id=58487093-6f51-4a4b-968a-82b38b604734,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58487093-6f') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:52.849643 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lazy-loading 'pci_devices' on Instance uuid 870f3e49-a1b4-4a7f-a936-66ed2280b505 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:52.871614 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.077054 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:53.077231 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:53.077456 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Attaching volume 31598b30-9bba-48ca-8710-053a06d2b0c0 to /dev/vdb Jun 03 01:06:53.128499 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:53.140232 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:06:53.162701 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:53.200155 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:06:53.202094 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:06:53.210239 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:06:53.210239 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feb8:822', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fe29:1d7b', 'fe80::fc16:3eff:fe5e:4e78', 'fe80::fc16:3eff:fee5:47da', 'fe80::fc16:3eff:fe6f:53ec', 'fe80::fc16:3eff:fe25:b72e', 'fe80::3c0a:faff:fe92:9db2'] Jun 03 01:06:53.210454 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:06:53.210883 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:06:53.211026 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:53.211623 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Updating existing volume attachment record: e5978ee9-a417-470f-96ba-e21095daa500 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] End _get_guest_xml xml= Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 870f3e49-a1b4-4a7f-a936-66ed2280b505 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: instance-0000000f Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 196608 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: tempest-device-tagging-server-1979192484 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 2026-06-03 01:06:41 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 192 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: True Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: bare Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: tempest-TaggedBootDevicesTest-1757420274-project-member Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: tempest-TaggedBootDevicesTest-1757420274 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 870f3e49-a1b4-4a7f-a936-66ed2280b505 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 870f3e49-a1b4-4a7f-a936-66ed2280b505 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: hvm Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 128 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: 43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: f21eee2a-ec1f-4025-94ec-0b807c046f78 Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: e2ae67a3-aa4d-424f-ba5e-c041a6f818df Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: Jun 03 01:06:53.354739 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Preparing to wait for external event network-vif-plugged-a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Preparing to wait for external event network-vif-plugged-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Preparing to wait for external event network-vif-plugged-2b0eef10-c9f6-488a-9800-6e7d807e7336 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Preparing to wait for external event network-vif-plugged-f898b240-5ec0-4735-90c6-f8aa562b0cac {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Preparing to wait for external event network-vif-plugged-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Preparing to wait for external event network-vif-plugged-3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Preparing to wait for external event network-vif-plugged-58487093-6f51-4a4b-968a-82b38b604734 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:53.361408 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:53.362644 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a320f909-4120-4240-816d-9a98fd363e9a", "address": "fa:16:3e:51:07:53", "network": {"id": "d10ab19a-aab5-4e75-a74f-de7b6c54ff1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1300013310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa320f909-41", "ovs_interfaceid": "a320f909-4120-4240-816d-9a98fd363e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:53.362644 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "a320f909-4120-4240-816d-9a98fd363e9a", "address": "fa:16:3e:51:07:53", "network": {"id": "d10ab19a-aab5-4e75-a74f-de7b6c54ff1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1300013310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa320f909-41", "ovs_interfaceid": "a320f909-4120-4240-816d-9a98fd363e9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:53.362644 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:07:53,bridge_name='br-int',has_traffic_filtering=True,id=a320f909-4120-4240-816d-9a98fd363e9a,network=Network(d10ab19a-aab5-4e75-a74f-de7b6c54ff1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa320f909-41') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:53.362644 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:07:53,bridge_name='br-int',has_traffic_filtering=True,id=a320f909-4120-4240-816d-9a98fd363e9a,network=Network(d10ab19a-aab5-4e75-a74f-de7b6c54ff1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa320f909-41') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:53.362644 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.363080 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.363127 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:53.364130 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.364193 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dd3f10c-598c-5054-a4bc-65e0e181e093', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.364992 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.365826 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.367304 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.369563 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.369768 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa320f909-41, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.370135 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa320f909-41, col_values=(('qos', UUID('527e36ad-80bf-4650-9728-dd28ba755d1f')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.370390 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa320f909-41, col_values=(('external_ids', {'iface-id': 'a320f909-4120-4240-816d-9a98fd363e9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:07:53', 'vm-uuid': '870f3e49-a1b4-4a7f-a936-66ed2280b505'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.371269 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.373060 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.380260 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.381275 np0000002000 nova-compute[98288]: INFO os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:07:53,bridge_name='br-int',has_traffic_filtering=True,id=a320f909-4120-4240-816d-9a98fd363e9a,network=Network(d10ab19a-aab5-4e75-a74f-de7b6c54ff1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa320f909-41') Jun 03 01:06:53.382133 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "address": "fa:16:3e:a8:11:d0", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7d0a64-f5", "ovs_interfaceid": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:53.382336 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "address": "fa:16:3e:a8:11:d0", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7d0a64-f5", "ovs_interfaceid": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:53.382913 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:11:d0,bridge_name='br-int',has_traffic_filtering=True,id=ae7d0a64-f5a4-4d43-84ce-d5f781f0b036,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae7d0a64-f5') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:53.383281 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:11:d0,bridge_name='br-int',has_traffic_filtering=True,id=ae7d0a64-f5a4-4d43-84ce-d5f781f0b036,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae7d0a64-f5') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:53.383621 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.383807 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.384006 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:53.384793 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.384958 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0953f7a0-5816-58a0-b0f1-bb458bd5ce48', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.385635 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.386201 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.392339 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.394349 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.394548 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae7d0a64-f5, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.394856 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae7d0a64-f5, col_values=(('qos', UUID('f1b93657-08bc-4bca-9849-8bd2105e68bc')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.395010 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae7d0a64-f5, col_values=(('external_ids', {'iface-id': 'ae7d0a64-f5a4-4d43-84ce-d5f781f0b036', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:11:d0', 'vm-uuid': '870f3e49-a1b4-4a7f-a936-66ed2280b505'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.398954 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.407645 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.409257 np0000002000 nova-compute[98288]: INFO os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:11:d0,bridge_name='br-int',has_traffic_filtering=True,id=ae7d0a64-f5a4-4d43-84ce-d5f781f0b036,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae7d0a64-f5') Jun 03 01:06:53.409996 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "address": "fa:16:3e:e3:c3:ae", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0eef10-c9", "ovs_interfaceid": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:53.410151 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "address": "fa:16:3e:e3:c3:ae", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0eef10-c9", "ovs_interfaceid": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:53.412865 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c3:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b0eef10-c9f6-488a-9800-6e7d807e7336,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b0eef10-c9') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:53.413344 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c3:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b0eef10-c9f6-488a-9800-6e7d807e7336,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b0eef10-c9') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:53.414890 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.415149 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.415384 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:53.417425 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.417746 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0848e1fd-e876-5e56-a967-f55dd0178d82', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.418961 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.420601 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.428866 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.431321 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.431685 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b0eef10-c9, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.431749 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b0eef10-c9, col_values=(('qos', UUID('37a287e3-76a5-4f90-a200-f13065f049f4')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.431924 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b0eef10-c9, col_values=(('external_ids', {'iface-id': '2b0eef10-c9f6-488a-9800-6e7d807e7336', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:c3:ae', 'vm-uuid': '870f3e49-a1b4-4a7f-a936-66ed2280b505'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.432743 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.433858 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.448085 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.448975 np0000002000 nova-compute[98288]: INFO os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c3:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b0eef10-c9f6-488a-9800-6e7d807e7336,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b0eef10-c9') Jun 03 01:06:53.449666 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "address": "fa:16:3e:b7:f3:8b", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf898b240-5e", "ovs_interfaceid": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:53.449866 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "address": "fa:16:3e:b7:f3:8b", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf898b240-5e", "ovs_interfaceid": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:53.450426 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f3:8b,bridge_name='br-int',has_traffic_filtering=True,id=f898b240-5ec0-4735-90c6-f8aa562b0cac,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf898b240-5e') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:53.450651 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f3:8b,bridge_name='br-int',has_traffic_filtering=True,id=f898b240-5ec0-4735-90c6-f8aa562b0cac,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf898b240-5e') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:53.450820 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.450972 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.451131 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:53.451820 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.451946 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56dcd86d-27d2-5dfb-b116-4a8bfd559dde', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.453280 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.453591 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.468454 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.470392 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.470623 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf898b240-5e, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.470949 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf898b240-5e, col_values=(('qos', UUID('6592d256-bbfe-49b5-b4f1-43a3fe0c3ac5')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.471150 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf898b240-5e, col_values=(('external_ids', {'iface-id': 'f898b240-5ec0-4735-90c6-f8aa562b0cac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:f3:8b', 'vm-uuid': '870f3e49-a1b4-4a7f-a936-66ed2280b505'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.471854 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.473469 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.495701 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.496880 np0000002000 nova-compute[98288]: INFO os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f3:8b,bridge_name='br-int',has_traffic_filtering=True,id=f898b240-5ec0-4735-90c6-f8aa562b0cac,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf898b240-5e') Jun 03 01:06:53.497799 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "address": "fa:16:3e:80:4c:19", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap185ebfc4-a0", "ovs_interfaceid": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:53.498045 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "address": "fa:16:3e:80:4c:19", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap185ebfc4-a0", "ovs_interfaceid": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:53.498571 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:4c:19,bridge_name='br-int',has_traffic_filtering=True,id=185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185ebfc4-a0') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:53.499404 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:4c:19,bridge_name='br-int',has_traffic_filtering=True,id=185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185ebfc4-a0') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:53.499404 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.499404 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.499404 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:53.500166 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.501477 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7125cf61-f034-5b4c-8432-027b605ea5ee', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.501477 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.501859 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.520768 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.523270 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.523500 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap185ebfc4-a0, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.523870 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap185ebfc4-a0, col_values=(('qos', UUID('dc91b601-3b0a-40ac-b474-74f4b85f7633')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.524545 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap185ebfc4-a0, col_values=(('external_ids', {'iface-id': '185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:4c:19', 'vm-uuid': '870f3e49-a1b4-4a7f-a936-66ed2280b505'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.526135 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.527819 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.540518 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:06:53.541353 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:06:53.542912 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Creating image(s) Jun 03 01:06:53.542912 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Did not create local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} Jun 03 01:06:53.542912 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Ensure instance console log exists: /opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:06:53.544941 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:53.544941 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:53.544941 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:53.544941 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Start _get_guest_xml network_info=[{"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'b1f02c15-7ace-4492-8f7b-ca612460360f', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '02e31daf-9f87-4574-be4b-3ed12bd8f050', 'attached_at': '', 'detached_at': '', 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'serial': '19696d01-3935-4ef0-b689-6591e9ad42e7'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:06:53.552929 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.552929 np0000002000 nova-compute[98288]: INFO os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:4c:19,bridge_name='br-int',has_traffic_filtering=True,id=185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185ebfc4-a0') Jun 03 01:06:53.553197 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "address": "fa:16:3e:23:58:90", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3239f51b-2b", "ovs_interfaceid": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:53.553320 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "address": "fa:16:3e:23:58:90", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3239f51b-2b", "ovs_interfaceid": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:53.553783 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:58:90,bridge_name='br-int',has_traffic_filtering=True,id=3239f51b-2bbd-4d49-a354-7e0a6a03549a,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3239f51b-2b') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:53.554351 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:58:90,bridge_name='br-int',has_traffic_filtering=True,id=3239f51b-2bbd-4d49-a354-7e0a6a03549a,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3239f51b-2b') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:53.554647 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:06:53.555928 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-371005072', uuid='02e31daf-9f87-4574-be4b-3ed12bd8f050'), owner=OwnerMeta(userid='6a5f52b75bd44cd880fcd26870d24190', username='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member', projectid='e3b5c165c8b142b6af1c20eeac918eb0', projectname='tempest-ServerBootFromVolumeStableRescueTest-1020364370'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448813.5555246) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:06:53.559388 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.559388 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.559388 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:53.559388 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.559388 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0dce644f-463d-5698-8404-65962fcd8b63', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.559519 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:06:53.559892 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:06:53.560040 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.561482 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.561822 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:06:53.561897 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:06:53.562998 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:06:53.563515 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:06:53.563631 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:06:53.564486 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:06:53.564486 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:06:53.564486 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:06:53.564486 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:06:53.564486 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:06:53.564727 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:06:53.569600 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Preparing to wait for external event volume-reimaged-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:53.569800 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:06:53.569960 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:53.570193 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:06:53.570355 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:53.570547 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:06:53.576167 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:53.583514 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:06:53.583514 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:53.583514 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:53.583514 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:53.583514 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:06:53.588471 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.595337 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.595835 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3239f51b-2b, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.596246 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3239f51b-2b, col_values=(('qos', UUID('eb352b69-0ab8-4df2-a64d-a11a9770a474')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.596470 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3239f51b-2b, col_values=(('external_ids', {'iface-id': '3239f51b-2bbd-4d49-a354-7e0a6a03549a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:58:90', 'vm-uuid': '870f3e49-a1b4-4a7f-a936-66ed2280b505'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.598753 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.599657 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.601902 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:53.602453 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:53.603533 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:53.603733 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:53.605113 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:53.605113 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:53.618079 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:53.618079 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:53.622914 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:53.622914 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:53.631772 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.634538 np0000002000 nova-compute[98288]: INFO os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:58:90,bridge_name='br-int',has_traffic_filtering=True,id=3239f51b-2bbd-4d49-a354-7e0a6a03549a,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3239f51b-2b') Jun 03 01:06:53.634538 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58487093-6f51-4a4b-968a-82b38b604734", "address": "fa:16:3e:60:04:19", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58487093-6f", "ovs_interfaceid": "58487093-6f51-4a4b-968a-82b38b604734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:53.634538 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "58487093-6f51-4a4b-968a-82b38b604734", "address": "fa:16:3e:60:04:19", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58487093-6f", "ovs_interfaceid": "58487093-6f51-4a4b-968a-82b38b604734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:53.634538 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:04:19,bridge_name='br-int',has_traffic_filtering=True,id=58487093-6f51-4a4b-968a-82b38b604734,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58487093-6f') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:53.635013 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:04:19,bridge_name='br-int',has_traffic_filtering=True,id=58487093-6f51-4a4b-968a-82b38b604734,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58487093-6f') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:53.635507 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.635826 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.636099 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:53.637492 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7] added Jun 03 01:06:53.637492 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:53.637492 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:53.637492 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:53.637492 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:53.637492 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:53.637492 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:53.638125 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:53.638852 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0347(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:53.639384 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:53.639976 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.639976 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dede388c-32bb-5ab1-accb-57eaa90d7233', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.640395 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.641220 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.641554 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7] added Jun 03 01:06:53.641554 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:53.641554 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:53.641554 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:53.641554 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:53.641554 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:53.641554 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:53.641723 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:53.641819 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:53.645500 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:53.677659 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.681879 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.682030 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58487093-6f, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.682304 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58487093-6f, col_values=(('qos', UUID('286d46d8-5887-4833-97b6-d7a0cdba640a')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.682423 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58487093-6f, col_values=(('external_ids', {'iface-id': '58487093-6f51-4a4b-968a-82b38b604734', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:04:19', 'vm-uuid': '870f3e49-a1b4-4a7f-a936-66ed2280b505'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:53.684197 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.685193 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:53.715122 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:53.720280 np0000002000 nova-compute[98288]: INFO os_vif [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:04:19,bridge_name='br-int',has_traffic_filtering=True,id=58487093-6f51-4a4b-968a-82b38b604734,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58487093-6f') Jun 03 01:06:53.776953 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:06:53.777984 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31598b30-9bba-48ca-8710-053a06d2b0c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:06:53.778468 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:54.639462 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:54.642372 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:54.651957 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:54.660148 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:54.664734 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:54.671971 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:54.687349 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.687349 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.687349 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.687349 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.687349 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.687349 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.687349 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.687349 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.687349 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:54.687659 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.687659 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.687659 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.687659 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.687659 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.687659 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.687659 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.687659 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.687659 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.689657 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:54.730678 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7, portal: 192.168.50.100,3260] Jun 03 01:06:54.730678 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7, portal: 192.168.50.100,3260] successful. Jun 03 01:06:54.730678 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:54.740570 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7, portal: 192.168.40.100,3260] Jun 03 01:06:54.740570 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7, portal: 192.168.40.100,3260] successful. Jun 03 01:06:54.740570 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:54.745981 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:54.753779 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:54.766818 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.766818 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.766818 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.766818 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.766818 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.766818 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.766818 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:54.766818 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.766818 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:54.766818 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.766818 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:54.767222 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.767222 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.767222 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.767222 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.767222 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.767222 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.767222 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:54.767222 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.767222 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:54.767222 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.767222 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:54.767533 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:54.767533 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:54.768493 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] HCTL ('11', '-', '-', 0) found on session 29 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:54.768674 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:54.772232 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.772232 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.772232 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.772232 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.772232 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.772232 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.772232 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:54.772232 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.772232 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:54.772232 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.772232 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:54.772738 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.772738 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:54.772738 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.772738 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:54.772738 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.772738 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:54.772738 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:54.772738 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.772738 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:54.772738 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:54.772738 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:54.773002 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:54.773002 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:54.774454 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] HCTL ('12', '-', '-', 0) found on session 30 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:54.774454 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:54.788304 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching for a device in session 29 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:54.788304 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:54.798881 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching for a device in session 30 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:54.798881 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:55.245548 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:55.245843 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:55.245947 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] No VIF found with MAC fa:16:3e:51:07:53, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:06:55.246167 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] No VIF found with MAC fa:16:3e:80:4c:19, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:06:55.246675 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Using config drive Jun 03 01:06:55.604809 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:06:55.648241 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:55.755553 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:55.900723 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Creating config drive at /opt/stack/data/nova/instances/870f3e49-a1b4-4a7f-a936-66ed2280b505/disk.config Jun 03 01:06:55.905672 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/870f3e49-a1b4-4a7f-a936-66ed2280b505/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpov6oyjkk {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:06:55.956919 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/870f3e49-a1b4-4a7f-a936-66ed2280b505/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpov6oyjkk" returned: 0 in 0.051s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:06:56.441263 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.491753 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.563994 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.623202 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Found WWN 3300000006583efdf for multipath device dm-2 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:06:56.623657 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:56.625007 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '3300000006583efdf', 'path': '/dev/dm-2', 'multipath_id': '3300000006583efdf'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:56.625007 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006583efdf', 'path': '/dev/dm-2', 'multipath_id': '3300000006583efdf'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:06:56.625780 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.847s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:56.626049 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31598b30-9bba-48ca-8710-053a06d2b0c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:06:56.639721 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:56.640294 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:56.640496 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:56.642900 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:06:56.643028 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:06:56.643267 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:56.661259 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:56.661259 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:56.665391 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:06:56.665391 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:56.681658 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.681658 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0] added Jun 03 01:06:56.681658 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:56.681658 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:56.681658 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:56.681658 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:56.681658 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:56.681658 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:56.681658 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:56.682027 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0413(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:56.682134 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:56.691597 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0] added Jun 03 01:06:56.691597 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:06:56.691597 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:56.691597 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:56.691597 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:06:56.691597 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:06:56.691597 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:56.691597 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:06:56.691597 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0483(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:06:56.691998 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:06:56.703130 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.727315 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.749647 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.799399 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.821229 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.835699 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.863455 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.878858 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.886022 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.927251 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.941499 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:56.945330 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-83ef2899-c9d8-45a0-b383-cff3bbb13d4b req-26e3c96d-461a-4c80-bd6b-6f6c479f146b service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-2b0eef10-c9f6-488a-9800-6e7d807e7336 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:56.945541 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-83ef2899-c9d8-45a0-b383-cff3bbb13d4b req-26e3c96d-461a-4c80-bd6b-6f6c479f146b service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:56.945709 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-83ef2899-c9d8-45a0-b383-cff3bbb13d4b req-26e3c96d-461a-4c80-bd6b-6f6c479f146b service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:56.945895 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-83ef2899-c9d8-45a0-b383-cff3bbb13d4b req-26e3c96d-461a-4c80-bd6b-6f6c479f146b service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:56.946027 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-83ef2899-c9d8-45a0-b383-cff3bbb13d4b req-26e3c96d-461a-4c80-bd6b-6f6c479f146b service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Processing event network-vif-plugged-2b0eef10-c9f6-488a-9800-6e7d807e7336 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:06:56.980377 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.040555 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.114830 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-cad84f88-85dc-4f0f-b11a-94b19b7268eb req-14604009-7015-4046-b53a-765c9e69e94e service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:57.115053 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-cad84f88-85dc-4f0f-b11a-94b19b7268eb req-14604009-7015-4046-b53a-765c9e69e94e service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:57.115236 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-cad84f88-85dc-4f0f-b11a-94b19b7268eb req-14604009-7015-4046-b53a-765c9e69e94e service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:57.115370 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-cad84f88-85dc-4f0f-b11a-94b19b7268eb req-14604009-7015-4046-b53a-765c9e69e94e service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:57.115512 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-cad84f88-85dc-4f0f-b11a-94b19b7268eb req-14604009-7015-4046-b53a-765c9e69e94e service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Processing event network-vif-plugged-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:06:57.119792 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.120654 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.123120 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.133309 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-371005072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-371005072',id=17,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-iub9iwve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:47Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=02e31daf-9f87-4574-be4b-3ed12bd8f050,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:06:57.133664 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:57.134840 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=d2016ef2-49b4-4aa3-bdc8-f0bef07c6901,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2016ef2-49') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:57.136198 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'pci_devices' on Instance uuid 02e31daf-9f87-4574-be4b-3ed12bd8f050 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:57.265749 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.275938 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.297356 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.315898 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.459773 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.459773 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.464638 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.486113 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] End _get_guest_xml xml= Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 02e31daf-9f87-4574-be4b-3ed12bd8f050 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: instance-00000011 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 196608 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-server-371005072 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 2026-06-03 01:06:53 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 192 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: True Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: bare Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 0 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: virtio Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-1020364370 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 02e31daf-9f87-4574-be4b-3ed12bd8f050 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 02e31daf-9f87-4574-be4b-3ed12bd8f050 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: hvm Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 128 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 1 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: 19696d01-3935-4ef0-b689-6591e9ad42e7 Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: Jun 03 01:06:57.642085 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:06:57.645649 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Preparing to wait for external event network-vif-plugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:06:57.645649 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:57.645649 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:57.645649 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:57.645649 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-371005072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-371005072',id=17,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-iub9iwve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:47Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=02e31daf-9f87-4574-be4b-3ed12bd8f050,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:06:57.645649 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:06:57.645649 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=d2016ef2-49b4-4aa3-bdc8-f0bef07c6901,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2016ef2-49') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:06:57.645649 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=d2016ef2-49b4-4aa3-bdc8-f0bef07c6901,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2016ef2-49') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:06:57.645649 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.646004 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:57.646004 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:06:57.649814 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.650055 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8ee761e-5518-5374-acfe-3b2c7a099c31', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:57.652013 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.652845 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:57.653456 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.655612 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.655862 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2016ef2-49, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:57.656157 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2016ef2-49, col_values=(('qos', UUID('5b2d0dcf-92f9-456d-ade1-bfc836213404')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:57.657477 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2016ef2-49, col_values=(('external_ids', {'iface-id': 'd2016ef2-49b4-4aa3-bdc8-f0bef07c6901', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:2b:99', 'vm-uuid': '02e31daf-9f87-4574-be4b-3ed12bd8f050'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:06:57.657702 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.659268 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:06:57.664818 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.665569 np0000002000 nova-compute[98288]: INFO os_vif [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=d2016ef2-49b4-4aa3-bdc8-f0bef07c6901,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2016ef2-49') Jun 03 01:06:57.682564 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:06:57.693792 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:57.703789 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:06:57.710272 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:57.719435 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:57.725693 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:57.747155 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.747155 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.747155 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.747155 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.747155 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.747155 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.747155 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.747155 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.747155 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.747155 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.747155 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:57.747429 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.747429 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.747429 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.747429 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.747429 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.747429 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.747429 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.747429 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.747429 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.747429 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.747429 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:57.755556 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.755556 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.755556 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.755556 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.755556 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.755556 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.755556 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.755556 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.755556 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.755556 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.755556 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:57.756780 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.756780 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.756780 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.756780 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.756780 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.756780 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.756780 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.756780 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.756780 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.756780 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.756780 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:57.764946 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.772117 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.816854 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0, portal: 192.168.40.100,3260] Jun 03 01:06:57.816854 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0, portal: 192.168.40.100,3260] successful. Jun 03 01:06:57.816854 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:57.819781 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0, portal: 192.168.50.100,3260] Jun 03 01:06:57.819781 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0, portal: 192.168.50.100,3260] successful. Jun 03 01:06:57.819781 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:57.833818 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:57.837840 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:06:57.859397 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.859397 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.859397 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.859397 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.859397 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.859397 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.859397 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.859397 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.859397 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.859397 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:06:57.859397 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:06:57.859397 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.859397 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:57.860044 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.860685 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:06:57.861083 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.861083 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:06:57.861083 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.861083 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:06:57.861083 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.861083 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:06:57.861083 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.861083 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.861083 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:06:57.861083 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:06:57.861083 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:06:57.861083 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:06:57.861083 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:06:57.861536 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.221s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:57.861772 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:06:57.865660 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] HCTL ('18', '-', '-', 0) found on session 32 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:57.865834 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:57.867548 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] HCTL ('17', '-', '-', 0) found on session 31 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:06:57.867681 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:06:57.874464 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.882558 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching for a device in session 32 and hctl ['18', '*', '*', 0] yield: None {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:57.918227 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching for a device in session 31 and hctl ['17', '*', '*', 0] yield: sdm {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:57.918227 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '31598b30-9bba-48ca-8710-053a06d2b0c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:57.966401 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:57.974096 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:58.079996 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:58.194157 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:58.203005 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:58.304976 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:58.304976 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] VM Started (Lifecycle Event) Jun 03 01:06:58.572158 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:58.582824 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:58.587379 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:58.612912 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:58.617501 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:58.813762 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:58.817473 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:06:58.817716 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] VM Paused (Lifecycle Event) Jun 03 01:06:58.884157 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching for a device in session 32 and hctl ['18', '*', '*', 0] yield: sdl {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:06:58.884452 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31598b30-9bba-48ca-8710-053a06d2b0c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:06:58.903729 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:58.913526 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:06:59.014360 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-ce6440e7-b8f5-4543-ba73-fe4a492684d1 req-5a1c02ad-9c9e-49dd-b6c8-4fe420ec199e service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-2b0eef10-c9f6-488a-9800-6e7d807e7336 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:59.014360 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ce6440e7-b8f5-4543-ba73-fe4a492684d1 req-5a1c02ad-9c9e-49dd-b6c8-4fe420ec199e service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:59.014589 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ce6440e7-b8f5-4543-ba73-fe4a492684d1 req-5a1c02ad-9c9e-49dd-b6c8-4fe420ec199e service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:59.014713 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ce6440e7-b8f5-4543-ba73-fe4a492684d1 req-5a1c02ad-9c9e-49dd-b6c8-4fe420ec199e service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:59.014905 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-ce6440e7-b8f5-4543-ba73-fe4a492684d1 req-5a1c02ad-9c9e-49dd-b6c8-4fe420ec199e service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No event matching network-vif-plugged-2b0eef10-c9f6-488a-9800-6e7d807e7336 in dict_keys([('network-vif-plugged', 'a320f909-4120-4240-816d-9a98fd363e9a'), ('network-vif-plugged', 'f898b240-5ec0-4735-90c6-f8aa562b0cac'), ('network-vif-plugged', '185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8'), ('network-vif-plugged', '3239f51b-2bbd-4d49-a354-7e0a6a03549a'), ('network-vif-plugged', '58487093-6f51-4a4b-968a-82b38b604734')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:06:59.014905 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-ce6440e7-b8f5-4543-ba73-fe4a492684d1 req-5a1c02ad-9c9e-49dd-b6c8-4fe420ec199e service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received unexpected event network-vif-plugged-2b0eef10-c9f6-488a-9800-6e7d807e7336 for instance with vm_state building and task_state spawning. Jun 03 01:06:59.190307 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:59.190919 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:06:59.190919 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No VIF found with MAC fa:16:3e:82:2b:99, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:06:59.191026 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Using config drive Jun 03 01:06:59.211686 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:59.212109 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:59.212776 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:59.214294 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:59.214294 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No event matching network-vif-plugged-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 in dict_keys([('network-vif-plugged', 'a320f909-4120-4240-816d-9a98fd363e9a'), ('network-vif-plugged', 'f898b240-5ec0-4735-90c6-f8aa562b0cac'), ('network-vif-plugged', '185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8'), ('network-vif-plugged', '3239f51b-2bbd-4d49-a354-7e0a6a03549a'), ('network-vif-plugged', '58487093-6f51-4a4b-968a-82b38b604734')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:06:59.214294 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received unexpected event network-vif-plugged-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 for instance with vm_state building and task_state spawning. Jun 03 01:06:59.214294 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-f898b240-5ec0-4735-90c6-f8aa562b0cac {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:59.214294 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:59.214294 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:59.214294 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:59.215118 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Processing event network-vif-plugged-f898b240-5ec0-4735-90c6-f8aa562b0cac {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:06:59.215389 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-f898b240-5ec0-4735-90c6-f8aa562b0cac {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:59.215669 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:59.216426 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:59.216724 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:59.217038 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No event matching network-vif-plugged-f898b240-5ec0-4735-90c6-f8aa562b0cac in dict_keys([('network-vif-plugged', 'a320f909-4120-4240-816d-9a98fd363e9a'), ('network-vif-plugged', '185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8'), ('network-vif-plugged', '3239f51b-2bbd-4d49-a354-7e0a6a03549a'), ('network-vif-plugged', '58487093-6f51-4a4b-968a-82b38b604734')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:06:59.218857 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received unexpected event network-vif-plugged-f898b240-5ec0-4735-90c6-f8aa562b0cac for instance with vm_state building and task_state spawning. Jun 03 01:06:59.218857 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:59.218857 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:59.218857 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:59.218857 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:59.218857 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Processing event network-vif-plugged-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:06:59.218857 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:59.218857 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:59.218857 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:59.218857 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:59.218857 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No event matching network-vif-plugged-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 in dict_keys([('network-vif-plugged', 'a320f909-4120-4240-816d-9a98fd363e9a'), ('network-vif-plugged', '3239f51b-2bbd-4d49-a354-7e0a6a03549a'), ('network-vif-plugged', '58487093-6f51-4a4b-968a-82b38b604734')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:06:59.219738 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received unexpected event network-vif-plugged-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 for instance with vm_state building and task_state spawning. Jun 03 01:06:59.220507 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-58487093-6f51-4a4b-968a-82b38b604734 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:59.221314 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:59.221575 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:59.221812 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:59.222229 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Processing event network-vif-plugged-58487093-6f51-4a4b-968a-82b38b604734 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:06:59.222347 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-58487093-6f51-4a4b-968a-82b38b604734 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:59.222609 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:59.223135 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:59.223360 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:59.223615 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No event matching network-vif-plugged-58487093-6f51-4a4b-968a-82b38b604734 in dict_keys([('network-vif-plugged', 'a320f909-4120-4240-816d-9a98fd363e9a'), ('network-vif-plugged', '3239f51b-2bbd-4d49-a354-7e0a6a03549a')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:06:59.224010 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-76973ced-11b4-450e-844c-173e2fc870d5 req-fac8fceb-0a8a-40a2-ae17-d714f0301de3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received unexpected event network-vif-plugged-58487093-6f51-4a4b-968a-82b38b604734 for instance with vm_state building and task_state spawning. Jun 03 01:06:59.320141 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:06:59.322101 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:06:59.604076 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e133faba-ecdd-40bd-886d-09f3405cd2e3 req-86af516e-08f1-4b10-9b0f-67261828a0e3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:06:59.604308 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e133faba-ecdd-40bd-886d-09f3405cd2e3 req-86af516e-08f1-4b10-9b0f-67261828a0e3 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:06:59.604582 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e133faba-ecdd-40bd-886d-09f3405cd2e3 req-86af516e-08f1-4b10-9b0f-67261828a0e3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:06:59.604787 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e133faba-ecdd-40bd-886d-09f3405cd2e3 req-86af516e-08f1-4b10-9b0f-67261828a0e3 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:06:59.604919 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e133faba-ecdd-40bd-886d-09f3405cd2e3 req-86af516e-08f1-4b10-9b0f-67261828a0e3 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Processing event network-vif-plugged-a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:06:59.675893 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Found WWN 3300000000d1cd1da for multipath device dm-9 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:06:59.676306 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:06:59.676557 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] <== connect_volume: return (5898ms) {'type': 'block', 'scsi_wwn': '3300000000d1cd1da', 'path': '/dev/dm-9', 'multipath_id': '3300000000d1cd1da'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:06:59.676738 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000d1cd1da', 'path': '/dev/dm-9', 'multipath_id': '3300000000d1cd1da'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:06:59.680358 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'flavor' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:06:59.700715 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:06:59.828167 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:07:00.034303 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Creating config drive at /opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.config Jun 03 01:07:00.039878 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbdm90mfe {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:00.087770 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbdm90mfe" returned: 0 in 0.048s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:00.187047 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Attempting to attach volume 31598b30-9bba-48ca-8710-053a06d2b0c0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98288) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 03 01:07:00.188935 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] attach device xml: Jun 03 01:07:00.188935 np0000002000 nova-compute[98288]: Jun 03 01:07:00.188935 np0000002000 nova-compute[98288]: Jun 03 01:07:00.188935 np0000002000 nova-compute[98288]: Jun 03 01:07:00.188935 np0000002000 nova-compute[98288]: Jun 03 01:07:00.188935 np0000002000 nova-compute[98288]: 31598b30-9bba-48ca-8710-053a06d2b0c0 Jun 03 01:07:00.188935 np0000002000 nova-compute[98288]: Jun 03 01:07:00.188935 np0000002000 nova-compute[98288]: {{(pid=98288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 03 01:07:00.411839 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005182649999824207 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:00.412494 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:00.412708 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:00.414286 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] VM Stopped (Lifecycle Event) Jun 03 01:07:00.414617 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.7744431319999876 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:00.414715 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=3.7743295450000005 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:00.477377 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:07:00.477595 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Cleaning up deleted instances {{(pid=98288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}} Jun 03 01:07:00.647652 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:00.678403 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:00.685250 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:00.767335 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:00.847183 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:00.849086 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:00.916982 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 1225d1ad-70c5-43e1-b8f0-927efb3ef6be] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:00.980641 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] There are 0 instances to clean {{(pid=98288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}} Jun 03 01:07:00.980935 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:07:00.981123 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Cleaning up deleted instances with incomplete migration {{(pid=98288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}} Jun 03 01:07:01.270947 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7b8f24b6-b6f6-41b0-b19e-fd33037fccd6 req-c5190a78-dabd-4770-ac95-259ed5d930d9 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received event network-vif-plugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:01.271246 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7b8f24b6-b6f6-41b0-b19e-fd33037fccd6 req-c5190a78-dabd-4770-ac95-259ed5d930d9 service nova] Acquiring lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:01.271519 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7b8f24b6-b6f6-41b0-b19e-fd33037fccd6 req-c5190a78-dabd-4770-ac95-259ed5d930d9 service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:01.271679 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7b8f24b6-b6f6-41b0-b19e-fd33037fccd6 req-c5190a78-dabd-4770-ac95-259ed5d930d9 service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:01.271864 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7b8f24b6-b6f6-41b0-b19e-fd33037fccd6 req-c5190a78-dabd-4770-ac95-259ed5d930d9 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Processing event network-vif-plugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:07:01.271913 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7b8f24b6-b6f6-41b0-b19e-fd33037fccd6 req-c5190a78-dabd-4770-ac95-259ed5d930d9 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received event network-vif-plugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:01.273291 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7b8f24b6-b6f6-41b0-b19e-fd33037fccd6 req-c5190a78-dabd-4770-ac95-259ed5d930d9 service nova] Acquiring lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:01.273802 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7b8f24b6-b6f6-41b0-b19e-fd33037fccd6 req-c5190a78-dabd-4770-ac95-259ed5d930d9 service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:01.273944 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7b8f24b6-b6f6-41b0-b19e-fd33037fccd6 req-c5190a78-dabd-4770-ac95-259ed5d930d9 service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:01.274154 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7b8f24b6-b6f6-41b0-b19e-fd33037fccd6 req-c5190a78-dabd-4770-ac95-259ed5d930d9 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] No waiting events found dispatching network-vif-plugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:01.274322 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-7b8f24b6-b6f6-41b0-b19e-fd33037fccd6 req-c5190a78-dabd-4770-ac95-259ed5d930d9 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received unexpected event network-vif-plugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 for instance with vm_state building and task_state spawning. Jun 03 01:07:01.467064 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:01.467539 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:07:01.468820 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] VM Started (Lifecycle Event) Jun 03 01:07:01.469583 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:07:01.473295 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Instance spawned successfully. Jun 03 01:07:01.474393 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:07:01.483945 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:07:01.712020 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:01.712476 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:01.712691 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:01.712875 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:01.713109 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No event matching network-vif-plugged-a320f909-4120-4240-816d-9a98fd363e9a in dict_keys([('network-vif-plugged', '3239f51b-2bbd-4d49-a354-7e0a6a03549a')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:07:01.713282 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received unexpected event network-vif-plugged-a320f909-4120-4240-816d-9a98fd363e9a for instance with vm_state building and task_state spawning. Jun 03 01:07:01.713473 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:01.713645 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:01.713827 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:01.714073 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:01.714233 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Processing event network-vif-plugged-3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:07:01.714417 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-plugged-3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:01.714599 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:01.715428 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Instance event wait completed in 3 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:07:01.715977 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:01.716219 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:01.716416 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-plugged-3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:01.716602 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-2a9751c6-b569-4be3-83ef-fe08926d00b1 req-f43b1fe3-8746-47a1-ac52-5207b62e1a70 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received unexpected event network-vif-plugged-3239f51b-2bbd-4d49-a354-7e0a6a03549a for instance with vm_state building and task_state spawning. Jun 03 01:07:01.719422 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:07:01.721647 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Instance spawned successfully. Jun 03 01:07:01.721998 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:07:01.972884 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:01.975549 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:01.984461 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:01.984694 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:01.985118 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:01.985426 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:01.985761 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:01.986091 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:01.989162 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:07:02.099429 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:02.099579 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:02.099628 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:02.099728 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No VIF found with MAC fa:16:3e:5e:4e:78, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:07:02.231634 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:02.231789 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:02.232170 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:02.232456 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:02.241167 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:02.241794 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:02.300905 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:02.469008 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:02.478841 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:07:02.479147 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:02.479303 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] VM Paused (Lifecycle Event) Jun 03 01:07:02.494074 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Took 8.95 seconds to spawn the instance on the hypervisor. Jun 03 01:07:02.494330 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:02.658420 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:02.755557 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Took 29.88 seconds to spawn the instance on the hypervisor. Jun 03 01:07:02.755855 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:02.878252 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:02.982559 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:02.984192 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:02.984192 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] VM Resumed (Lifecycle Event) Jun 03 01:07:02.988749 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:07:02.989401 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:07:02.989401 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 03 01:07:02.990264 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:07:03.015714 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Took 19.98 seconds to build instance. Jun 03 01:07:03.273056 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Took 44.68 seconds to build instance. Jun 03 01:07:03.473173 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:07:03.474830 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:07:03.477096 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:07:03.477708 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:07:03.486973 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:03.488606 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:03.519537 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e06018ea-9761-4dbf-a071-7fa05272784f tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.486s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:03.695939 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0a6e727a-11c5-41f8-8650-0a205fa65ce2 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.618s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:03.775248 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6a1a44d-b66d-49cb-9a9b-8bfbc8fb4762 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 46.198s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:03.993945 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:03.994364 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] VM Resumed (Lifecycle Event) Jun 03 01:07:04.187497 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:04.189384 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00031670499993197154 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:04.189765 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:04.189892 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:04.189990 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] VM Stopped (Lifecycle Event) Jun 03 01:07:04.201356 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Rescuing Jun 03 01:07:04.201890 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:04.202416 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquired lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:04.202416 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:07:04.479006 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:07:04.479006 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:07:04.479157 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:07:04.498109 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:04.499925 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:04.693042 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-84dd226f-7819-4e23-9f36-4ba52217a491 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:04.707192 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:04.968227 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Rescuing Jun 03 01:07:04.968480 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "refresh_cache-02e31daf-9f87-4574-be4b-3ed12bd8f050" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:04.968605 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquired lock "refresh_cache-02e31daf-9f87-4574-be4b-3ed12bd8f050" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:04.968733 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:07:05.433332 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:05.484899 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:05.780061 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5eb6f863-eb2a-423e-b5cd-06c1bc12a2f6 req-2e4a3f58-d690-4f39-89d6-a4cd2a1db2e9 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-changed-a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:05.780061 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5eb6f863-eb2a-423e-b5cd-06c1bc12a2f6 req-2e4a3f58-d690-4f39-89d6-a4cd2a1db2e9 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing instance network info cache due to event network-changed-a320f909-4120-4240-816d-9a98fd363e9a. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:07:05.781244 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5eb6f863-eb2a-423e-b5cd-06c1bc12a2f6 req-2e4a3f58-d690-4f39-89d6-a4cd2a1db2e9 service nova] Acquiring lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:05.781244 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5eb6f863-eb2a-423e-b5cd-06c1bc12a2f6 req-2e4a3f58-d690-4f39-89d6-a4cd2a1db2e9 service nova] Acquired lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:05.781244 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-5eb6f863-eb2a-423e-b5cd-06c1bc12a2f6 req-2e4a3f58-d690-4f39-89d6-a4cd2a1db2e9 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Refreshing network info cache for port a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:07:05.992114 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:06.081006 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:06.139225 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Updating instance_info_cache with network_info: [{"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:06.286037 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-5eb6f863-eb2a-423e-b5cd-06c1bc12a2f6 req-2e4a3f58-d690-4f39-89d6-a4cd2a1db2e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:06.386367 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Updating instance_info_cache with network_info: [{"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:06.482505 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:07:06.482947 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:07:06.563640 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:06.643645 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Releasing lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:06.738555 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-5eb6f863-eb2a-423e-b5cd-06c1bc12a2f6 req-2e4a3f58-d690-4f39-89d6-a4cd2a1db2e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:06.890400 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Releasing lock "refresh_cache-02e31daf-9f87-4574-be4b-3ed12bd8f050" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:06.947432 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-5eb6f863-eb2a-423e-b5cd-06c1bc12a2f6 req-2e4a3f58-d690-4f39-89d6-a4cd2a1db2e9 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updated VIF entry in instance network info cache for port a320f909-4120-4240-816d-9a98fd363e9a. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:07:06.948516 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-5eb6f863-eb2a-423e-b5cd-06c1bc12a2f6 req-2e4a3f58-d690-4f39-89d6-a4cd2a1db2e9 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updating instance_info_cache with network_info: [{"id": "a320f909-4120-4240-816d-9a98fd363e9a", "address": "fa:16:3e:51:07:53", "network": {"id": "d10ab19a-aab5-4e75-a74f-de7b6c54ff1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1300013310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa320f909-41", "ovs_interfaceid": "a320f909-4120-4240-816d-9a98fd363e9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "address": "fa:16:3e:a8:11:d0", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7d0a64-f5", "ovs_interfaceid": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "address": "fa:16:3e:e3:c3:ae", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0eef10-c9", "ovs_interfaceid": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "address": "fa:16:3e:b7:f3:8b", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf898b240-5e", "ovs_interfaceid": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "address": "fa:16:3e:80:4c:19", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap185ebfc4-a0", "ovs_interfaceid": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "address": "fa:16:3e:23:58:90", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3239f51b-2b", "ovs_interfaceid": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58487093-6f51-4a4b-968a-82b38b604734", "address": "fa:16:3e:60:04:19", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58487093-6f", "ovs_interfaceid": "58487093-6f51-4a4b-968a-82b38b604734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:06.996356 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:06.996356 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:06.998330 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.006s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:06.998891 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Auditing locally available compute resources for np0000002000 (node: np0000002000) {{(pid=98288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 03 01:07:07.453336 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5eb6f863-eb2a-423e-b5cd-06c1bc12a2f6 req-2e4a3f58-d690-4f39-89d6-a4cd2a1db2e9 service nova] Releasing lock "refresh_cache-870f3e49-a1b4-4a7f-a936-66ed2280b505" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:07.677225 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:07.882522 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:08.058978 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:08.145662 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:08.146572 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:08.241692 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:08.246658 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} Jun 03 01:07:08.246786 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} Jun 03 01:07:08.246886 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] skipping disk /dev/dm-1 (vdc) as it is a volume {{(pid=98288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} Jun 03 01:07:08.251323 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:08.294137 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:08.299138 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:08.322603 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:08.338085 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:08.338085 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:08.419462 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:08.424373 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} Jun 03 01:07:08.426049 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} Jun 03 01:07:08.465587 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:08.471916 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:08.477191 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:08.538407 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:08.543198 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:08.566774 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:08.569092 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:08.569307 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:08.611200 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999180128000035 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:08.611792 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998355607999883 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:08.611967 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998172113999999 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:08.614543 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Instance destroyed successfully. Jun 03 01:07:08.614967 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'numa_topology' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:08.628519 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-0234b270-c842-469e-935e-2bfb730d4a0e req-b6235be3-8d70-440e-9112-7bef3d3e7b8a service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:08.628519 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-0234b270-c842-469e-935e-2bfb730d4a0e req-b6235be3-8d70-440e-9112-7bef3d3e7b8a service nova] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:08.628519 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-0234b270-c842-469e-935e-2bfb730d4a0e req-b6235be3-8d70-440e-9112-7bef3d3e7b8a service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:08.628519 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-0234b270-c842-469e-935e-2bfb730d4a0e req-b6235be3-8d70-440e-9112-7bef3d3e7b8a service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:08.629382 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-0234b270-c842-469e-935e-2bfb730d4a0e req-b6235be3-8d70-440e-9112-7bef3d3e7b8a service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] No waiting events found dispatching network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:08.629382 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-0234b270-c842-469e-935e-2bfb730d4a0e req-b6235be3-8d70-440e-9112-7bef3d3e7b8a service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received unexpected event network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e for instance with vm_state active and task_state rescuing. Jun 03 01:07:08.669791 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:08.670595 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} Jun 03 01:07:08.674462 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:08.728730 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:08.738459 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:08.752735 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:08.754722 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 req-8edcbca4-c0bb-43af-a553-ecab2e717684 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event volume-reimaged-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:08.754944 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 req-8edcbca4-c0bb-43af-a553-ecab2e717684 service nova] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:08.755125 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 req-8edcbca4-c0bb-43af-a553-ecab2e717684 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:08.755510 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 req-8edcbca4-c0bb-43af-a553-ecab2e717684 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:08.755658 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 req-8edcbca4-c0bb-43af-a553-ecab2e717684 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Processing event volume-reimaged-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:07:08.759470 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:08.768181 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Instance event wait completed in 14 seconds for volume-reimaged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:07:08.835461 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:08.838212 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999738503999879 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:08.840545 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:08.840717 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Instance destroyed successfully. Jun 03 01:07:08.841284 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'numa_topology' on Instance uuid 02e31daf-9f87-4574-be4b-3ed12bd8f050 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:08.915816 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:08.916256 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:08.990191 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b/disk --force-share --output=json" returned: 0 in 0.074s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:08.993259 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:09.076378 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue --force-share --output=json" returned: 0 in 0.083s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:09.077374 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:09.124028 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Attempting rescue Jun 03 01:07:09.125260 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} Jun 03 01:07:09.131279 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Instance directory exists: not creating {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} Jun 03 01:07:09.131431 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Creating image(s) Jun 03 01:07:09.132518 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "/opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:09.132518 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "/opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:09.135897 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "/opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.003s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:09.136184 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:09.160702 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:09.186864 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue --force-share --output=json" returned: 0 in 0.110s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:09.187282 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:09.276958 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Booting with volume 9f4e6e13-762a-4df4-82c3-0f4e04b9b688 at /dev/vda Jun 03 01:07:09.280224 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:09.280875 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:09.357346 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Attempting a stable device rescue Jun 03 01:07:09.366261 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:07:09.380767 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:07:09.384293 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:09.386382 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:07:09.387313 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:09.412827 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:09.417284 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:09.419335 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:09.447895 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "env LANG=C uptime" returned: 0 in 0.060s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:09.448287 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Hypervisor/Node resource view: name=np0000002000 free_ram=12254MB free_disk=74.3674087524414GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 03 01:07:09.448917 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:09.449264 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:09.454951 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:07:09.457285 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:07:09.467838 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:07:09.469710 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feb8:822', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fe29:1d7b', 'fe80::fc16:3eff:fee5:47da', 'fe80::fc16:3eff:fe6f:53ec', 'fe80::fc16:3eff:fe25:b72e', 'fe80::3c0a:faff:fe92:9db2', 'fe80::fc16:3eff:fe51:753', 'fe80::9c48:feff:fe93:c1b5', 'fe80::fc16:3eff:fea8:11d0', 'fe80::fc16:3eff:fee3:c3ae', 'fe80::fc16:3eff:feb7:f38b', 'fe80::fc16:3eff:fe80:4c19', 'fe80::fc16:3eff:fe23:5890', 'fe80::d88b:eeff:fe9b:9ecb', 'fe80::fc16:3eff:fe60:419', 'fe80::c4cf:61ff:fe10:8573'] Jun 03 01:07:09.469710 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:07:09.469889 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:07:09.470024 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:07:09.470772 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Updating existing volume attachment record: 968aca25-dada-4a2e-8ead-6d306f089327 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:07:09.506710 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} Jun 03 01:07:09.508803 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Instance directory exists: not creating {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} Jun 03 01:07:09.508938 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Creating image(s) Jun 03 01:07:09.509581 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "/opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:09.509767 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "/opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:09.510204 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "/opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:09.510518 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'trusted_certs' on Instance uuid 02e31daf-9f87-4574-be4b-3ed12bd8f050 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:09.639609 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<0584c6a8-64fc-4891-ba12-b8ede4275b95> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:09.640204 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:09.643163 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:09.644080 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:09.644672 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:09.645011 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:09.655826 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:09.656221 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:09.726823 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.070s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:09.727246 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.rescue {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:09.768022 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.rescue" returned: 0 in 0.040s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:09.768489 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.124s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:09.768884 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'migration_context' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:09.918942 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:07:10.013087 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<02e31daf-9f87-4574-be4b-3ed12bd8f050> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:10.013370 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:10.013858 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:10.271533 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<0584c6a8-64fc-4891-ba12-b8ede4275b95> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:10.271968 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:07:10.272798 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Start _get_guest_xml network_info=[{"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "vif_mac": "fa:16:3e:5e:4e:78"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue={'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:07:10.273173 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'resources' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:10.490932 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:10.525734 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:07:10.525872 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance cbb3ba9a-f26f-40c4-ac5b-00470740fd96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:07:10.525981 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 2bdcee06-76d6-431e-bef1-84b1acf1ccca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:07:10.526109 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 5fa25fea-9624-4611-8579-d6891f822679 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:07:10.526227 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance fd0a3a08-1a8c-482c-836a-19ac700c473f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:07:10.528468 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 0584c6a8-64fc-4891-ba12-b8ede4275b95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:07:10.528468 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 71626a81-876a-40b9-ae4f-a57455bf345b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:07:10.528468 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 870f3e49-a1b4-4a7f-a936-66ed2280b505 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:07:10.528468 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:07:10.528468 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 02e31daf-9f87-4574-be4b-3ed12bd8f050 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:07:10.625359 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:10.630201 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:10.631110 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f.part --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:10.695031 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-68a5d458-5018-4b8e-b8e8-a9f37e93aca6 req-816201ce-e462-4c0b-ae99-29dc5568b0bf service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:10.695373 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-68a5d458-5018-4b8e-b8e8-a9f37e93aca6 req-816201ce-e462-4c0b-ae99-29dc5568b0bf service nova] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:10.695641 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-68a5d458-5018-4b8e-b8e8-a9f37e93aca6 req-816201ce-e462-4c0b-ae99-29dc5568b0bf service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:10.695806 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-68a5d458-5018-4b8e-b8e8-a9f37e93aca6 req-816201ce-e462-4c0b-ae99-29dc5568b0bf service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:10.695966 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-68a5d458-5018-4b8e-b8e8-a9f37e93aca6 req-816201ce-e462-4c0b-ae99-29dc5568b0bf service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] No waiting events found dispatching network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:10.696122 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-68a5d458-5018-4b8e-b8e8-a9f37e93aca6 req-816201ce-e462-4c0b-ae99-29dc5568b0bf service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received unexpected event network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e for instance with vm_state active and task_state rescuing. Jun 03 01:07:10.738682 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f.part --force-share --output=json" returned: 0 in 0.108s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:10.739182 np0000002000 nova-compute[98288]: DEBUG nova.virt.images [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] ce2db2d6-60a7-4de7-ba13-c1d1818b7937 was qcow2, converting to raw {{(pid=98288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 03 01:07:10.739913 np0000002000 nova-compute[98288]: DEBUG nova.privsep.utils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 03 01:07:10.740218 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f.part /opt/stack/data/nova/instances/_base/64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f.converted {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:10.776537 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<0584c6a8-64fc-4891-ba12-b8ede4275b95> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:10.782099 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:07:10.783877 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-481754813', uuid='0584c6a8-64fc-4891-ba12-b8ede4275b95'), owner=OwnerMeta(userid='a97328826b194121a85a35b41129c1a9', username='tempest-ServerRescueNegativeTestJSON-335039479-project-member', projectid='8d71b7749b9b414ea4fb3ad943aebf49', projectname='tempest-ServerRescueNegativeTestJSON-335039479'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "vif_mac": "fa:16:3e:5e:4e:78"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448830.7833714) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:07:10.784748 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:07:10.785106 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:07:10.785805 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:07:10.786244 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:07:10.787433 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:07:10.787950 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:07:10.788151 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:07:10.788304 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:07:10.788462 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:07:10.788538 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:07:10.788661 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:07:10.788905 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:07:10.789068 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:07:10.789195 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:07:10.789300 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:07:10.789404 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:07:10.790131 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:10.829285 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f.part /opt/stack/data/nova/instances/_base/64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f.converted" returned: 0 in 0.089s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:10.835356 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f.converted --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:10.938947 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f.converted --force-share --output=json" returned: 0 in 0.103s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:10.939583 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.926s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:10.940088 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:10.943205 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:10.944252 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:10.944713 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:10.945231 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:10.948359 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:10.948714 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:11.025781 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f --force-share --output=json" returned: 0 in 0.077s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:11.026230 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f,backing_fmt=raw /opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.rescue {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:11.036970 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}} Jun 03 01:07:11.037541 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 03 01:07:11.038027 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Final resource view: name=np0000002000 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:07:09 up 30 min, 2 users, load average: 10.02, 5.36, 2.50\n', 'num_instances': '10', 'num_vm_active': '9', 'num_task_None': '7', 'num_os_type_None': '10', 'num_proj_e3b5c165c8b142b6af1c20eeac918eb0': '4', 'io_workload': '2', 'num_proj_8d71b7749b9b414ea4fb3ad943aebf49': '3', 'num_vm_rescued': '1', 'num_task_rebuild_block_device_mapping': '1', 'num_proj_ae2da6faf29d4db18ccfc9a42a93ab7d': '1', 'num_task_rescuing': '2', 'num_proj_7f0b405f69b049b390b824dd46c5fa95': '1', 'num_proj_88e01380196548bbbe8f5f9e9147494b': '1'} {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 03 01:07:11.069835 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f,backing_fmt=raw /opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.rescue" returned: 0 in 0.044s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:11.070203 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "64275ee8ccd76e9a4ca407c2395e4dbdcd9c835f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.126s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:11.070452 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'migration_context' on Instance uuid 02e31daf-9f87-4574-be4b-3ed12bd8f050 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:11.187532 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:11.292810 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<0584c6a8-64fc-4891-ba12-b8ede4275b95> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:11.307549 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-481754813',display_name='tempest-ServerRescueNegativeTestJSON-server-481754813',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverrescuenegativetestjson-server-481754813',id=13,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL1bTBKcpZPABlrsAC0BEunnlWZIWUncp1/s0rBJZiMFQjI/YvZ2jDYP4Ergq3etXYSswYhNLR8uVFWr/Jo8efkJFJWEw+g8AUr5Em0kds/F9DhSJhBU+c6WxuFLkZllw==',key_name='tempest-keypair-1134454194',keypairs=,launch_index=0,launched_at=2026-06-03T01:06:12Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8d71b7749b9b414ea4fb3ad943aebf49',ramdisk_id='',reservation_id='r-dhd481f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-335039479',owner_user_name='tempest-ServerRescueNegativeTestJSON-335039479-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:06:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a97328826b194121a85a35b41129c1a9',uuid=0584c6a8-64fc-4891-ba12-b8ede4275b95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "vif_mac": "fa:16:3e:5e:4e:78"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:07:11.307773 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converting VIF {"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "vif_mac": "fa:16:3e:5e:4e:78"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:11.308371 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:4e:78,bridge_name='br-int',has_traffic_filtering=True,id=32c927ec-8321-4de0-9cd5-36aaf8f01e7e,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c927ec-83') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:11.308916 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'pci_devices' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:11.572603 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<02e31daf-9f87-4574-be4b-3ed12bd8f050> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:11.572908 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:07:11.573976 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Start _get_guest_xml network_info=[{"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "vif_mac": "fa:16:3e:82:2b:99"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue={'image_id': 'ce2db2d6-60a7-4de7-ba13-c1d1818b7937', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'b1f02c15-7ace-4492-8f7b-ca612460360f', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, 'status': 'reserved', 'instance': '02e31daf-9f87-4574-be4b-3ed12bd8f050', 'attached_at': '', 'detached_at': '', 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'serial': '19696d01-3935-4ef0-b689-6591e9ad42e7'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:07:11.573976 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'resources' on Instance uuid 02e31daf-9f87-4574-be4b-3ed12bd8f050 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:11.614778 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:07:11.616722 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Creating image(s) Jun 03 01:07:11.617895 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Did not create local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} Jun 03 01:07:11.618065 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Ensure instance console log exists: /opt/stack/data/nova/instances/fd0a3a08-1a8c-482c-836a-19ac700c473f/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:07:11.618526 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:11.618752 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:11.618897 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:11.619436 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Start _get_guest_xml network_info=[{"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-03T01:02:22Z,direct_url=,disk_format='qcow2',id=d525a532-1643-48cd-87e8-a667d774c5cf,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-06-03T01:02:25Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '968aca25-dada-4a2e-8ead-6d306f089327', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fd0a3a08-1a8c-482c-836a-19ac700c473f', 'attached_at': '', 'detached_at': '', 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'serial': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:07:11.627116 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:07:11.627399 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:07:11.630957 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Jun 03 01:07:11.632946 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='d525a532-1643-48cd-87e8-a667d774c5cf', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1297217656', uuid='fd0a3a08-1a8c-482c-836a-19ac700c473f'), owner=OwnerMeta(userid='d5200a7ff60b4b65812c39efec311990', username='tempest-ServerActionsV293TestJSON-378692121-project-member', projectid='ae2da6faf29d4db18ccfc9a42a93ab7d', projectname='tempest-ServerActionsV293TestJSON-378692121'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448831.63182) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:07:11.633704 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:07:11.634639 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:07:11.636432 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:07:11.636432 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:07:11.637054 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:07:11.637372 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-03T01:02:22Z,direct_url=,disk_format='qcow2',id=d525a532-1643-48cd-87e8-a667d774c5cf,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-06-03T01:02:25Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:07:11.637582 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:07:11.637709 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:07:11.637869 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:07:11.638010 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:07:11.639649 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:07:11.644058 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:07:11.644058 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:07:11.644058 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:07:11.644058 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:07:11.644058 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:07:11.644058 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd0a3a08-1a8c-482c-836a-19ac700c473f {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:11.811704 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<0584c6a8-64fc-4891-ba12-b8ede4275b95> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] End _get_guest_xml xml= Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 0584c6a8-64fc-4891-ba12-b8ede4275b95 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: instance-0000000d Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 196608 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-server-481754813 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 2026-06-03 01:07:10 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 192 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: True Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: bare Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: ide Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: virtio Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: pc Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: virtio Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: virtio Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: virtio Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-335039479-project-member Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: tempest-ServerRescueNegativeTestJSON-335039479 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 0584c6a8-64fc-4891-ba12-b8ede4275b95 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 0584c6a8-64fc-4891-ba12-b8ede4275b95 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: hvm Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 128 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: Jun 03 01:07:11.812636 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:07:11.820651 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Instance destroyed successfully. Jun 03 01:07:12.075779 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<02e31daf-9f87-4574-be4b-3ed12bd8f050> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:12.077280 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:07:12.078297 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-371005072', uuid='02e31daf-9f87-4574-be4b-3ed12bd8f050'), owner=OwnerMeta(userid='6a5f52b75bd44cd880fcd26870d24190', username='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member', projectid='e3b5c165c8b142b6af1c20eeac918eb0', projectname='tempest-ServerBootFromVolumeStableRescueTest-1020364370'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "vif_mac": "fa:16:3e:82:2b:99"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448832.0780318) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:07:12.079116 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:07:12.079486 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:07:12.080220 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:07:12.080416 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:07:12.081078 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:07:12.081392 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:07:12.081605 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:07:12.081744 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:07:12.081919 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:07:12.082042 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:07:12.082176 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:07:12.082366 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:07:12.082527 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:07:12.082688 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:07:12.082833 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:07:12.082984 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:07:12.083153 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'vcpu_model' on Instance uuid 02e31daf-9f87-4574-be4b-3ed12bd8f050 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:12.129767 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:07:12.162450 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:07:12.162870 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:07:12.163035 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:12.163406 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:12.163731 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:07:12.176126 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:12.176701 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:12.177248 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:12.177578 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:07:12.177994 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:12.178216 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:07:12.189785 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:07:12.189785 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:12.192998 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:07:12.192998 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:12.202893 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688] added Jun 03 01:07:12.202893 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:07:12.202893 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:07:12.202893 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:07:12.202893 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:07:12.202893 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:07:12.202893 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:12.203394 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688] added Jun 03 01:07:12.203394 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:07:12.203394 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:07:12.203394 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:07:12.203394 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:07:12.203394 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:07:12.203394 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:12.203646 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:07:12.203921 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:07:12.204428 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:07:12.204688 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:07:12.204894 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:07:12.205023 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:07:12.584994 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<02e31daf-9f87-4574-be4b-3ed12bd8f050> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:12.596043 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.config --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:12.638566 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Compute_service record updated for np0000002000:np0000002000 {{(pid=98288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 03 01:07:12.638817 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.190s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:12.639311 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.149s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:12.643512 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:07:12.643690 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Claim successful on node np0000002000 Jun 03 01:07:12.647431 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.99 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:07:12.680628 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:12.685077 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.config --force-share --output=json" returned: 0 in 0.089s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:12.685483 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "/opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:12.685725 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "/opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:12.686225 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "/opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:12.686604 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:07:12.686994 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:07:12.687169 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:12.883537 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:13.205402 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:07:13.206090 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:07:13.218273 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:07:13.226164 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:13.230804 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:13.239288 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:13.254864 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.254864 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.254864 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.254864 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.254864 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.254864 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.254864 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.254864 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.254864 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.254864 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.254864 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.254864 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.254864 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:13.255198 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.255198 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.255198 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.255198 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.255198 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.255198 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.255198 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.255198 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.255198 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.255198 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.255198 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.255198 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.255198 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:13.264137 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.264137 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.264137 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.264137 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.264137 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.264137 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.264137 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.264137 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.264137 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.264137 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.264137 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.264137 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.264137 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:13.265314 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.265314 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.265314 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.265314 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.265314 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.265314 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.265314 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.265314 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.265314 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.265314 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.265314 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.265314 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.265314 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:13.316053 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.40.100,3260] Jun 03 01:07:13.316053 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.40.100,3260] successful. Jun 03 01:07:13.316053 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:13.327908 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:13.335033 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.50.100,3260] Jun 03 01:07:13.335033 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.50.100,3260] successful. Jun 03 01:07:13.335033 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:13.338982 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:13.338982 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:13.338982 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:13.338982 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] No VIF found with MAC fa:16:3e:5e:4e:78, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:07:13.338982 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Using config drive Jun 03 01:07:13.348126 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:13.355874 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:07:13.358853 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] HCTL ('19', '-', '-', 0) found on session 35 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:07:13.358853 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:13.372518 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:07:13.376294 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] HCTL ('20', '-', '-', 0) found on session 36 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:07:13.376294 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:07:13.376294 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Searching for a device in session 35 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:07:13.376294 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:07:13.390038 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Searching for a device in session 36 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:07:13.390286 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:07:13.842533 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:14.163785 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:14.167923 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:07:14.168190 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:07:14.180425 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:07:14.347938 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<0584c6a8-64fc-4891-ba12-b8ede4275b95> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:14.349366 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'keypairs' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:14.671285 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:07:14.854469 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<0584c6a8-64fc-4891-ba12-b8ede4275b95> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:14.855351 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:14.974886 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Creating config drive at /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.config.rescue Jun 03 01:07:14.977360 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvs0t88rk {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:15.034679 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvs0t88rk" returned: 0 in 0.057s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:15.179107 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.539s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:15.179107 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:07:15.201250 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Found WWN 330000000ddb5455d for multipath device dm-10 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:07:15.201250 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:15.201484 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000ddb5455d', 'path': '/dev/dm-10', 'multipath_id': '330000000ddb5455d'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:07:15.203077 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.515s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:15.203839 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ddb5455d', 'path': '/dev/dm-10', 'multipath_id': '330000000ddb5455d'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:07:15.203839 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:07:15.219575 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:15.220331 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:15.220920 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:15.221239 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:07:15.221912 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:15.222116 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.startup = automatic Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.scan = manual Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:07:15.236847 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.startup = automatic Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.scan = manual Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:07:15.247663 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:15.253664 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:15.262826 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:15.277209 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:15.277607 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:15.277894 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:15.277894 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:07:15.278531 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] HCTL ('12', '0', '0', 0) found on session 30 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:07:15.278623 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:15.287263 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:15.287635 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:15.287947 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.066s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:15.287947 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:07:15.288218 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching for a device in session 30 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:07:15.288391 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:07:15.289180 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] HCTL ('11', '0', '0', 0) found on session 29 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:07:15.289297 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:07:15.297180 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Searching for a device in session 29 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:07:15.297346 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:07:15.479328 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:15.520727 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:15.520727 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:15.600679 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:15.667797 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:15.673974 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:15.691423 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:07:15.692657 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:07:15.693049 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:15.693295 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:15.714641 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-03T01:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1297217656',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serveractionsv293testjson-server-1203236219',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOg/hEenxdNX4Z4QcNELt5stRwXZTqpWqT/PnVuKXCyR5nUlt1GylsaLK+alFPxegCcwDcE1qtmOZmRjXIw2iSsxnqNGSTWidkIuhnCdIaEbbKV6LWajW9bpcLx4K00nA==',key_name='tempest-keypair-2103291389',keypairs=,launch_index=0,launched_at=2026-06-03T01:06:05Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ae2da6faf29d4db18ccfc9a42a93ab7d',ramdisk_id='',reservation_id='r-1quzjl2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d525a532-1643-48cd-87e8-a667d774c5cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-378692121',owner_user_name='tempest-ServerActionsV293TestJSON-378692121-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:07:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5200a7ff60b4b65812c39efec311990',uuid=fd0a3a08-1a8c-482c-836a-19ac700c473f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:07:15.714641 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Converting VIF {"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:15.715316 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] End _get_guest_xml xml= Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: fd0a3a08-1a8c-482c-836a-19ac700c473f Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: instance-0000000c Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 196608 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: tempest-ServerActionsV293TestJSON-server-1297217656 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 2026-06-03 01:07:11 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 192 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: True Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: bare Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: virtio Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: tempest-ServerActionsV293TestJSON-378692121-project-member Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: tempest-ServerActionsV293TestJSON-378692121 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: fd0a3a08-1a8c-482c-836a-19ac700c473f Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: fd0a3a08-1a8c-482c-836a-19ac700c473f Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: hvm Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 128 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: 9f4e6e13-762a-4df4-82c3-0f4e04b9b688 Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: Jun 03 01:07:15.718797 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:07:15.722538 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-03T01:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1297217656',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serveractionsv293testjson-server-1203236219',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOg/hEenxdNX4Z4QcNELt5stRwXZTqpWqT/PnVuKXCyR5nUlt1GylsaLK+alFPxegCcwDcE1qtmOZmRjXIw2iSsxnqNGSTWidkIuhnCdIaEbbKV6LWajW9bpcLx4K00nA==',key_name='tempest-keypair-2103291389',keypairs=,launch_index=0,launched_at=2026-06-03T01:06:05Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ae2da6faf29d4db18ccfc9a42a93ab7d',ramdisk_id='',reservation_id='r-1quzjl2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d525a532-1643-48cd-87e8-a667d774c5cf',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-378692121',owner_user_name='tempest-ServerActionsV293TestJSON-378692121-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:07:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5200a7ff60b4b65812c39efec311990',uuid=fd0a3a08-1a8c-482c-836a-19ac700c473f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:07:15.722538 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Converting VIF {"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:15.723122 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:15.724878 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:07:15.725060 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:15.725328 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:15.725581 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:07:15.727821 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:15.727999 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c16380b1-9eb9-52fb-9b3a-ee6e50d665a9', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:15.729033 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:15.729743 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:15.739852 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:15.749608 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:15.749861 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4966a48-96, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:15.750201 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4966a48-96, col_values=(('qos', UUID('b47a9006-4cf3-40c1-a6a5-0cb3328f0960')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:15.750366 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4966a48-96, col_values=(('external_ids', {'iface-id': 'c4966a48-9680-4d94-b3d2-f1ffb52ae18f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:40:dc', 'vm-uuid': 'fd0a3a08-1a8c-482c-836a-19ac700c473f'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:15.753401 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:15.763221 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:15.765452 np0000002000 nova-compute[98288]: INFO os_vif [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') Jun 03 01:07:15.789829 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b482a336677a42c3b1cf5c9268771151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a3f095839e4616a6f1efd27c8d5e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:07:15.804781 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-3e5d1118-97b7-49e5-979f-571129decd3f req-5653223b-02b0-4ea9-8220-8275cf5796ac service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:15.805358 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-3e5d1118-97b7-49e5-979f-571129decd3f req-5653223b-02b0-4ea9-8220-8275cf5796ac service nova] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:15.806495 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-3e5d1118-97b7-49e5-979f-571129decd3f req-5653223b-02b0-4ea9-8220-8275cf5796ac service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:15.806495 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-3e5d1118-97b7-49e5-979f-571129decd3f req-5653223b-02b0-4ea9-8220-8275cf5796ac service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:15.806495 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-3e5d1118-97b7-49e5-979f-571129decd3f req-5653223b-02b0-4ea9-8220-8275cf5796ac service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] No waiting events found dispatching network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:15.806495 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-3e5d1118-97b7-49e5-979f-571129decd3f req-5653223b-02b0-4ea9-8220-8275cf5796ac service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received unexpected event network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e for instance with vm_state active and task_state rescuing. Jun 03 01:07:16.192182 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:07:16.222095 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:07:16.253477 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Successfully created port: 49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:07:16.390770 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:16.422397 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Removed pending STOPPED event for 0584c6a8-64fc-4891-ba12-b8ede4275b95 due to new event Resumed> {{(pid=98288) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 03 01:07:16.422519 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:16.422611 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] VM Resumed (Lifecycle Event) Jun 03 01:07:16.428312 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-83922973-81ae-4382-b583-f28275b2810a tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:16.696922 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:07:16.859111 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Successfully updated port: 49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:07:16.929762 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:16.931846 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:17.247362 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Found WWN 3300000006583efdf for multipath device dm-2 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:07:17.247809 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.046s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:17.247897 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] <== connect_volume: return (4561ms) {'type': 'block', 'scsi_wwn': '3300000006583efdf', 'path': '/dev/dm-2', 'multipath_id': '3300000006583efdf'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:07:17.248032 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006583efdf', 'path': '/dev/dm-2', 'multipath_id': '3300000006583efdf'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:07:17.286052 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:17.287027 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:17.287027 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] No VIF found with MAC fa:16:3e:52:40:dc, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:07:17.287027 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Using config drive Jun 03 01:07:17.362820 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:17.362929 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquired lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:17.363104 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:07:17.437631 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:17.437784 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] VM Started (Lifecycle Event) Jun 03 01:07:17.710908 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:07:17.713012 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:07:17.713411 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Creating image(s) Jun 03 01:07:17.713945 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:17.714162 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "/opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:17.714649 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "/opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:17.715216 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:17.718148 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:17.719205 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:17.755850 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-371005072',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-371005072',id=17,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-03T01:07:02Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-iub9iwve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:07:03Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=02e31daf-9f87-4574-be4b-3ed12bd8f050,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "vif_mac": "fa:16:3e:82:2b:99"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:07:17.756214 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "vif_mac": "fa:16:3e:82:2b:99"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:17.757357 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=d2016ef2-49b4-4aa3-bdc8-f0bef07c6901,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2016ef2-49') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:17.759059 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'pci_devices' on Instance uuid 02e31daf-9f87-4574-be4b-3ed12bd8f050 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:17.795720 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lazy-loading 'ec2_ids' on Instance uuid fd0a3a08-1a8c-482c-836a-19ac700c473f {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:17.798664 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-72e88738-57c7-482f-acac-e80120343fe4 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Unrescuing Jun 03 01:07:17.799031 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-72e88738-57c7-482f-acac-e80120343fe4 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:17.799643 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-72e88738-57c7-482f-acac-e80120343fe4 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquired lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:17.800092 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-72e88738-57c7-482f-acac-e80120343fe4 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:07:17.812005 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.093s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:17.813141 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:17.813141 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:17.813732 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:17.818957 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:17.819054 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:17.884573 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:17.884573 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:17.884573 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:17.884573 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:17.884573 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] No waiting events found dispatching network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:17.884573 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received unexpected event network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e for instance with vm_state rescued and task_state unrescuing. Jun 03 01:07:17.884573 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received event network-changed-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:17.884573 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Refreshing instance network info cache due to event network-changed-49f6412d-4366-42e3-a2f7-19a20cc8c032. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:07:17.884823 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] Acquiring lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:17.886821 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:17.924837 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.106s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:17.925202 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:17.942768 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:17.951249 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:07:17.958945 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:17.978792 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk 1073741824" returned: 0 in 0.053s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:17.979888 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.166s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:17.979888 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:18.060842 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.081s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:18.061416 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:07:18.061794 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:18.125858 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-a6672eb6-4aca-4c36-a9a3-c81967bf65a7 req-17752cf4-51a9-4848-89ee-041736af26e1 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received event network-vif-unplugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:18.126116 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-a6672eb6-4aca-4c36-a9a3-c81967bf65a7 req-17752cf4-51a9-4848-89ee-041736af26e1 service nova] Acquiring lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:18.126333 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-a6672eb6-4aca-4c36-a9a3-c81967bf65a7 req-17752cf4-51a9-4848-89ee-041736af26e1 service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:18.126474 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-a6672eb6-4aca-4c36-a9a3-c81967bf65a7 req-17752cf4-51a9-4848-89ee-041736af26e1 service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:18.126596 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-a6672eb6-4aca-4c36-a9a3-c81967bf65a7 req-17752cf4-51a9-4848-89ee-041736af26e1 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] No waiting events found dispatching network-vif-unplugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:18.126720 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-a6672eb6-4aca-4c36-a9a3-c81967bf65a7 req-17752cf4-51a9-4848-89ee-041736af26e1 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received unexpected event network-vif-unplugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 for instance with vm_state active and task_state rescuing. Jun 03 01:07:18.159836 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:18.160597 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Cannot resize image /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:07:18.161097 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:07:18.161631 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Ensure instance console log exists: /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:07:18.162007 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:18.162322 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:18.162610 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:18.173336 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:18.263110 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<02e31daf-9f87-4574-be4b-3ed12bd8f050> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] End _get_guest_xml xml= Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 02e31daf-9f87-4574-be4b-3ed12bd8f050 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: instance-00000011 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 196608 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-server-371005072 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 2026-06-03 01:07:12 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 192 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: True Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: bare Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: ide Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: virtio Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: pc Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: virtio Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: virtio Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: virtio Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: tempest-ServerBootFromVolumeStableRescueTest-1020364370 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 02e31daf-9f87-4574-be4b-3ed12bd8f050 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 02e31daf-9f87-4574-be4b-3ed12bd8f050 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: hvm Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 128 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: 19696d01-3935-4ef0-b689-6591e9ad42e7 Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: Jun 03 01:07:18.265161 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:07:18.271168 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Instance destroyed successfully. Jun 03 01:07:18.302263 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Object Instance lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:18.302456 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lazy-loading 'keypairs' on Instance uuid fd0a3a08-1a8c-482c-836a-19ac700c473f {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:18.304976 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-72e88738-57c7-482f-acac-e80120343fe4 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:18.374051 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Updating instance_info_cache with network_info: [{"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:18.462913 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 03 01:07:18.745390 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-72e88738-57c7-482f-acac-e80120343fe4 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:18.808542 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Object Instance lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:18.812428 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError Jun 03 01:07:18.877065 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Releasing lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:18.877065 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Instance network_info: |[{"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:07:18.878193 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] Acquired lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:18.879376 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Refreshing network info cache for port 49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:07:18.883717 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Start _get_guest_xml network_info=[{"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:07:18.886776 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:07:18.888370 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-739464815', uuid='2ae68109-fd4c-4cb8-ac62-f49800f5ec34'), owner=OwnerMeta(userid='b482a336677a42c3b1cf5c9268771151', username='tempest-ServerStableDeviceRescueTest-945622888-project-member', projectid='a2a3f095839e4616a6f1efd27c8d5e7e', projectname='tempest-ServerStableDeviceRescueTest-945622888'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448838.8879352) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:07:18.889603 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:07:18.890041 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:07:18.893041 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:07:18.893041 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:07:18.893041 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:07:18.893041 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:07:18.893223 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:07:18.893356 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:07:18.893575 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:07:18.893718 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:07:18.893873 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:07:18.894077 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:07:18.894234 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:07:18.894519 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:07:18.894781 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:07:18.894989 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:07:18.913848 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:07:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-739464815',display_name='tempest-ServerStableDeviceRescueTest-server-739464815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverstabledevicerescuetest-server-739464815',id=18,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL4uaTRkCs5om2btENDK/YTPB1lzuMHJcKzLndcGBlnI5Kz04RXQ+W7oGWRWPiV35Rc0mZNAN6Y5n5UIt8TGUuyjlFMoXUbXgAtDbLgM5TCSWesRgzhOSlJUjuLGOFJDg==',key_name='tempest-keypair-1226587213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2a3f095839e4616a6f1efd27c8d5e7e',ramdisk_id='',reservation_id='r-v6hw0fdo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-945622888',owner_user_name='tempest-ServerStableDeviceRescueTest-945622888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b482a336677a42c3b1cf5c9268771151',uuid=2ae68109-fd4c-4cb8-ac62-f49800f5ec34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:07:18.914091 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Converting VIF {"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:18.914848 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c4:5e,bridge_name='br-int',has_traffic_filtering=True,id=49f6412d-4366-42e3-a2f7-19a20cc8c032,network=Network(6866ea75-ee2b-4dbc-87c7-4617f6e4222d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f6412d-43') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:18.915585 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:18.951272 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-72e88738-57c7-482f-acac-e80120343fe4 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Updating instance_info_cache with network_info: [{"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:18.982173 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Creating config drive at /opt/stack/data/nova/instances/fd0a3a08-1a8c-482c-836a-19ac700c473f/disk.config Jun 03 01:07:18.986221 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fd0a3a08-1a8c-482c-836a-19ac700c473f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp36h3i786 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:19.031682 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fd0a3a08-1a8c-482c-836a-19ac700c473f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp36h3i786" returned: 0 in 0.045s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:19.208367 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.388450 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] End _get_guest_xml xml= Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: instance-00000012 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 196608 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: tempest-ServerStableDeviceRescueTest-server-739464815 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 2026-06-03 01:07:18 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 192 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: True Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: bare Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: virtio Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: tempest-ServerStableDeviceRescueTest-945622888-project-member Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: tempest-ServerStableDeviceRescueTest-945622888 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: hvm Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 128 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Preparing to wait for external event network-vif-plugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:07:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-739464815',display_name='tempest-ServerStableDeviceRescueTest-server-739464815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverstabledevicerescuetest-server-739464815',id=18,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL4uaTRkCs5om2btENDK/YTPB1lzuMHJcKzLndcGBlnI5Kz04RXQ+W7oGWRWPiV35Rc0mZNAN6Y5n5UIt8TGUuyjlFMoXUbXgAtDbLgM5TCSWesRgzhOSlJUjuLGOFJDg==',key_name='tempest-keypair-1226587213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2a3f095839e4616a6f1efd27c8d5e7e',ramdisk_id='',reservation_id='r-v6hw0fdo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-945622888',owner_user_name='tempest-ServerStableDeviceRescueTest-945622888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b482a336677a42c3b1cf5c9268771151',uuid=2ae68109-fd4c-4cb8-ac62-f49800f5ec34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Converting VIF {"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c4:5e,bridge_name='br-int',has_traffic_filtering=True,id=49f6412d-4366-42e3-a2f7-19a20cc8c032,network=Network(6866ea75-ee2b-4dbc-87c7-4617f6e4222d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f6412d-43') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:19.421894 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c4:5e,bridge_name='br-int',has_traffic_filtering=True,id=49f6412d-4366-42e3-a2f7-19a20cc8c032,network=Network(6866ea75-ee2b-4dbc-87c7-4617f6e4222d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f6412d-43') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:07:19.424033 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.424033 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:19.424033 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:07:19.426701 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.441642 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd023bb3-fd3b-5ae0-83e5-1103ce3fd1c1', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:19.441943 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.443995 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:19.456149 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-72e88738-57c7-482f-acac-e80120343fe4 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Releasing lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:19.456149 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-72e88738-57c7-482f-acac-e80120343fe4 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'flavor' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:19.456981 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.472902 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.472991 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49f6412d-43, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:19.474968 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49f6412d-43, col_values=(('qos', UUID('5d893168-3373-4130-8ebd-cdc5ba277ae4')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:19.475271 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49f6412d-43, col_values=(('external_ids', {'iface-id': '49f6412d-4366-42e3-a2f7-19a20cc8c032', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:c4:5e', 'vm-uuid': '2ae68109-fd4c-4cb8-ac62-f49800f5ec34'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:19.477051 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.479346 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:19.490504 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.491673 np0000002000 nova-compute[98288]: INFO os_vif [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c4:5e,bridge_name='br-int',has_traffic_filtering=True,id=49f6412d-4366-42e3-a2f7-19a20cc8c032,network=Network(6866ea75-ee2b-4dbc-87c7-4617f6e4222d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f6412d-43') Jun 03 01:07:19.539485 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.582122 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.585262 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.672092 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.782804 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:19.798098 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:19.798098 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:19.798098 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:19.798098 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] No VIF found with MAC fa:16:3e:82:2b:99, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:07:19.798098 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Using config drive Jun 03 01:07:19.913997 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.927368 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.931639 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.962399 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.975522 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:19.984919 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Updated VIF entry in instance network info cache for port 49f6412d-4366-42e3-a2f7-19a20cc8c032. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:07:19.985317 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Updating instance_info_cache with network_info: [{"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:20.002409 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:20.003828 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:20.029325 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:20.230944 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-f12c3c2a-97c4-4edf-97fe-8aeef7fadeb7 req-759adadb-b386-42bc-928c-fa472f5c7437 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:20.230944 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-f12c3c2a-97c4-4edf-97fe-8aeef7fadeb7 req-759adadb-b386-42bc-928c-fa472f5c7437 service nova] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:20.231137 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-f12c3c2a-97c4-4edf-97fe-8aeef7fadeb7 req-759adadb-b386-42bc-928c-fa472f5c7437 service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:20.231137 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-f12c3c2a-97c4-4edf-97fe-8aeef7fadeb7 req-759adadb-b386-42bc-928c-fa472f5c7437 service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:20.231304 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-f12c3c2a-97c4-4edf-97fe-8aeef7fadeb7 req-759adadb-b386-42bc-928c-fa472f5c7437 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] No waiting events found dispatching network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:20.231405 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-f12c3c2a-97c4-4edf-97fe-8aeef7fadeb7 req-759adadb-b386-42bc-928c-fa472f5c7437 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received unexpected event network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e for instance with vm_state rescued and task_state unrescuing. Jun 03 01:07:20.235608 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received event network-vif-unplugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:20.236187 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] Acquiring lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:20.236310 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:20.236420 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:20.236549 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] No waiting events found dispatching network-vif-unplugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:20.236658 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received unexpected event network-vif-unplugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 for instance with vm_state active and task_state rescuing. Jun 03 01:07:20.236751 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received event network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:20.236869 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] Acquiring lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:20.236978 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:20.237069 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:20.237168 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] No event matching network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 in dict_keys([('network-vif-plugged', '49f6412d-4366-42e3-a2f7-19a20cc8c032')]) {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 03 01:07:20.237289 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received unexpected event network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 for instance with vm_state building and task_state spawning. Jun 03 01:07:20.237382 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event network-vif-plugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:20.237507 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:20.237650 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:20.237735 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:20.237822 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] No waiting events found dispatching network-vif-plugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:20.237914 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received unexpected event network-vif-plugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f for instance with vm_state active and task_state rebuild_spawning. Jun 03 01:07:20.238011 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event network-vif-plugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:20.238121 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:20.238242 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:20.238331 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:20.238425 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] No waiting events found dispatching network-vif-plugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:20.238540 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-2c9244c2-cef2-4ff9-8b10-7e9eeafaa006 req-5b74b1eb-6312-4e05-8539-d6324b216cf0 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received unexpected event network-vif-plugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f for instance with vm_state active and task_state rebuild_spawning. Jun 03 01:07:20.270162 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:20.290830 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:20.301090 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'ec2_ids' on Instance uuid 02e31daf-9f87-4574-be4b-3ed12bd8f050 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:20.315362 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:20.323745 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999556993999931 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:20.331833 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Instance destroyed successfully. Jun 03 01:07:20.332513 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-72e88738-57c7-482f-acac-e80120343fe4 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'numa_topology' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:20.491118 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ac3af3af-5a18-4ea1-aff1-6f7dc4be5f73 req-7c2e9971-a40b-4e99-8759-4121a87dd375 service nova] Releasing lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:20.572758 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:20.573053 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] VM Resumed (Lifecycle Event) Jun 03 01:07:20.574636 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Instance event wait completed in 0 seconds for {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:07:20.575077 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:07:20.579861 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Instance spawned successfully. Jun 03 01:07:20.580329 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:07:20.813648 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<02e31daf-9f87-4574-be4b-3ed12bd8f050> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:20.813648 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'keypairs' on Instance uuid 02e31daf-9f87-4574-be4b-3ed12bd8f050 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:20.835629 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-72e88738-57c7-482f-acac-e80120343fe4 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Object Instance<0584c6a8-64fc-4891-ba12-b8ede4275b95> lazy-loaded attributes: flavor,numa_topology {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:21.015053 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:21.015388 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:21.015388 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] No VIF found with MAC fa:16:3e:2e:c4:5e, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:07:21.018208 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Using config drive Jun 03 01:07:21.077463 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:21.078942 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:21.090064 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:21.090262 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:21.090740 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:21.090827 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:21.091231 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:21.091352 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:21.315567 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<02e31daf-9f87-4574-be4b-3ed12bd8f050> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:21.324617 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:21.325784 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:21.365279 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:21.373577 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:21.492837 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:21.510327 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:21.525868 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:21.526162 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:21.535506 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Creating config drive at /opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.config.rescue Jun 03 01:07:21.538719 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi57kge8q {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:21.582097 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip. Jun 03 01:07:21.582570 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:21.582676 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] VM Started (Lifecycle Event) Jun 03 01:07:21.593470 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi57kge8q" returned: 0 in 0.055s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:21.600461 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:21.860878 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Creating config drive at /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.config Jun 03 01:07:21.865632 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqi9or34_ {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:21.925380 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqi9or34_" returned: 0 in 0.059s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:22.086753 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:22.091786 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:22.112684 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:22.112876 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:22.113021 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98288) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}} Jun 03 01:07:22.267765 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:22.314560 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:22.337786 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-452ff304-70d2-4753-a54a-4eaeb7762580 req-acfa3356-5c19-4e22-ba43-b89bc66d7d99 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:22.338050 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-452ff304-70d2-4753-a54a-4eaeb7762580 req-acfa3356-5c19-4e22-ba43-b89bc66d7d99 service nova] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:22.338268 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-452ff304-70d2-4753-a54a-4eaeb7762580 req-acfa3356-5c19-4e22-ba43-b89bc66d7d99 service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:22.338655 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-452ff304-70d2-4753-a54a-4eaeb7762580 req-acfa3356-5c19-4e22-ba43-b89bc66d7d99 service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:22.338836 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-452ff304-70d2-4753-a54a-4eaeb7762580 req-acfa3356-5c19-4e22-ba43-b89bc66d7d99 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] No waiting events found dispatching network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:22.338988 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-452ff304-70d2-4753-a54a-4eaeb7762580 req-acfa3356-5c19-4e22-ba43-b89bc66d7d99 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received unexpected event network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e for instance with vm_state rescued and task_state unrescuing. Jun 03 01:07:22.439620 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-72e88738-57c7-482f-acac-e80120343fe4 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:22.453893 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:22.463020 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:22.486412 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:22.597578 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Removed pending STOPPED event for 0584c6a8-64fc-4891-ba12-b8ede4275b95 due to new event Resumed> {{(pid=98288) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 03 01:07:22.598323 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:22.598323 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] VM Resumed (Lifecycle Event) Jun 03 01:07:22.750948 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:22.757159 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:22.783155 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:22.849079 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:22.890528 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:23.101574 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:23.110645 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:23.120606 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:23.122977 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:23.125222 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c4079ff1-5f7f-4920-915d-ee8cc1c51768 tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.012s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:23.126536 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:23.149364 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:23.275804 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:23.573196 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a023cbed-6fbd-457c-b5f1-b3befdced274 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:23.611899 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00043375800009926024 future=) was cancelled during its delay period, skipping {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:23.611899 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:23.611899 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.2270677919998434 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:23.611899 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.22697815899982743 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:23.612600 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:23.612789 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] VM Started (Lifecycle Event) Jun 03 01:07:23.838331 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.000354552000089825 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:23.838760 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:23.840223 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:23.840420 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=11.48267887499992 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:23.840651 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] VM Stopped (Lifecycle Event) Jun 03 01:07:23.843267 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=11.479831685999898 future=) was cancelled while queued, skipping {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:23.843332 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:24.120811 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:24.123143 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:24.345879 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:24.425778 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c4bc0cb6-22d5-47b4-95c0-ec92883f5a18 req-100b944f-590c-4cd0-8fd9-3f7d0d377568 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:24.426189 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c4bc0cb6-22d5-47b4-95c0-ec92883f5a18 req-100b944f-590c-4cd0-8fd9-3f7d0d377568 service nova] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:24.426371 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c4bc0cb6-22d5-47b4-95c0-ec92883f5a18 req-100b944f-590c-4cd0-8fd9-3f7d0d377568 service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:24.426533 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c4bc0cb6-22d5-47b4-95c0-ec92883f5a18 req-100b944f-590c-4cd0-8fd9-3f7d0d377568 service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:24.426647 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c4bc0cb6-22d5-47b4-95c0-ec92883f5a18 req-100b944f-590c-4cd0-8fd9-3f7d0d377568 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] No waiting events found dispatching network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:24.426818 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-c4bc0cb6-22d5-47b4-95c0-ec92883f5a18 req-100b944f-590c-4cd0-8fd9-3f7d0d377568 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received unexpected event network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e for instance with vm_state active and task_state None. Jun 03 01:07:24.426854 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c4bc0cb6-22d5-47b4-95c0-ec92883f5a18 req-100b944f-590c-4cd0-8fd9-3f7d0d377568 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:24.426974 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c4bc0cb6-22d5-47b4-95c0-ec92883f5a18 req-100b944f-590c-4cd0-8fd9-3f7d0d377568 service nova] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:24.427106 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c4bc0cb6-22d5-47b4-95c0-ec92883f5a18 req-100b944f-590c-4cd0-8fd9-3f7d0d377568 service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:24.427207 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c4bc0cb6-22d5-47b4-95c0-ec92883f5a18 req-100b944f-590c-4cd0-8fd9-3f7d0d377568 service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:24.427317 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c4bc0cb6-22d5-47b4-95c0-ec92883f5a18 req-100b944f-590c-4cd0-8fd9-3f7d0d377568 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] No waiting events found dispatching network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:24.427420 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-c4bc0cb6-22d5-47b4-95c0-ec92883f5a18 req-100b944f-590c-4cd0-8fd9-3f7d0d377568 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received unexpected event network-vif-plugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e for instance with vm_state active and task_state None. Jun 03 01:07:24.477952 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:24.626109 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:24.626562 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] VM Resumed (Lifecycle Event) Jun 03 01:07:25.130672 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:25.132758 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:25.283183 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:25.372191 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-1369053b-8fb8-4519-a22d-c310dc897266 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Unrescuing Jun 03 01:07:25.372457 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1369053b-8fb8-4519-a22d-c310dc897266 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "refresh_cache-02e31daf-9f87-4574-be4b-3ed12bd8f050" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:25.372619 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1369053b-8fb8-4519-a22d-c310dc897266 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquired lock "refresh_cache-02e31daf-9f87-4574-be4b-3ed12bd8f050" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:25.373073 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-1369053b-8fb8-4519-a22d-c310dc897266 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:07:25.635588 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 03 01:07:25.636093 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:25.636093 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] VM Started (Lifecycle Event) Jun 03 01:07:25.876124 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-1369053b-8fb8-4519-a22d-c310dc897266 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:26.139051 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:26.144356 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:26.211745 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-1369053b-8fb8-4519-a22d-c310dc897266 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:26.423665 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-1369053b-8fb8-4519-a22d-c310dc897266 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Updating instance_info_cache with network_info: [{"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:26.530643 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-changed-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:26.534209 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Refreshing instance network info cache due to event network-changed-32c927ec-8321-4de0-9cd5-36aaf8f01e7e. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:07:26.534494 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] Acquiring lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:26.534614 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] Acquired lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:26.534739 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Refreshing network info cache for port 32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:07:26.650264 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 03 01:07:26.651172 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:26.651172 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] VM Started (Lifecycle Event) Jun 03 01:07:26.671129 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:26.671277 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:26.925710 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1369053b-8fb8-4519-a22d-c310dc897266 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Releasing lock "refresh_cache-02e31daf-9f87-4574-be4b-3ed12bd8f050" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:26.926187 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-1369053b-8fb8-4519-a22d-c310dc897266 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'flavor' on Instance uuid 02e31daf-9f87-4574-be4b-3ed12bd8f050 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:27.037201 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:27.155453 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:27.159902 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:27.160072 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] VM Paused (Lifecycle Event) Jun 03 01:07:27.174971 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lazy-loading 'flavor' on Instance uuid d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:27.305451 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:27.443775 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Updated VIF entry in instance network info cache for port 32c927ec-8321-4de0-9cd5-36aaf8f01e7e. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:07:27.443775 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Updating instance_info_cache with network_info: [{"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:27.469828 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:27.476969 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:27.499089 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:27.618218 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:27.624200 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:27.664116 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:27.666749 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:27.760291 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Instance destroyed successfully. Jun 03 01:07:27.760291 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-1369053b-8fb8-4519-a22d-c310dc897266 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'numa_topology' on Instance uuid 02e31daf-9f87-4574-be4b-3ed12bd8f050 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:27.894933 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:27.944835 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] Releasing lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:27.945572 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-changed-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:27.945572 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Refreshing instance network info cache due to event network-changed-32c927ec-8321-4de0-9cd5-36aaf8f01e7e. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:07:27.945572 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] Acquiring lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:27.945572 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] Acquired lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:27.945572 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Refreshing network info cache for port 32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:07:28.145777 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-098e6226-81b2-4a8d-b8ea-309e9eb4cc2b req-80f0b268-f237-49da-97a9-f6f84b9e601a service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received event network-vif-plugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:28.146158 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-098e6226-81b2-4a8d-b8ea-309e9eb4cc2b req-80f0b268-f237-49da-97a9-f6f84b9e601a service nova] Acquiring lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:28.146334 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-098e6226-81b2-4a8d-b8ea-309e9eb4cc2b req-80f0b268-f237-49da-97a9-f6f84b9e601a service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:28.146516 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-098e6226-81b2-4a8d-b8ea-309e9eb4cc2b req-80f0b268-f237-49da-97a9-f6f84b9e601a service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:28.146671 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-098e6226-81b2-4a8d-b8ea-309e9eb4cc2b req-80f0b268-f237-49da-97a9-f6f84b9e601a service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] No waiting events found dispatching network-vif-plugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:28.147066 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-098e6226-81b2-4a8d-b8ea-309e9eb4cc2b req-80f0b268-f237-49da-97a9-f6f84b9e601a service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received unexpected event network-vif-plugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 for instance with vm_state rescued and task_state unrescuing. Jun 03 01:07:28.168803 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:07:28.169121 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999840630000108 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:28.169304 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999645705000148 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:28.169384 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.99956175300008 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:28.183966 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.513s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:28.262873 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-1369053b-8fb8-4519-a22d-c310dc897266 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Object Instance<02e31daf-9f87-4574-be4b-3ed12bd8f050> lazy-loaded attributes: flavor,numa_topology {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:07:28.449771 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:28.732538 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:28.760456 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:28.766334 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:28.875229 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:28.878462 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:28.913462 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:29.027167 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Updated VIF entry in instance network info cache for port 32c927ec-8321-4de0-9cd5-36aaf8f01e7e. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:07:29.027385 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Updating instance_info_cache with network_info: [{"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:29.327574 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:29.330461 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:29.330461 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Attaching volume ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 to /dev/vdb Jun 03 01:07:29.378998 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:07:29.390115 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:07:29.411024 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:29.447839 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:07:29.448282 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:07:29.459944 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:07:29.462348 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:feb8:822', 'fe80::6c0b:b1ff:fec8:abc4', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe72:87e7', 'fe80::fc16:3eff:fe29:1d7b', 'fe80::fc16:3eff:fee5:47da', 'fe80::fc16:3eff:fe6f:53ec', 'fe80::fc16:3eff:fe25:b72e', 'fe80::3c0a:faff:fe92:9db2', 'fe80::fc16:3eff:fe51:753', 'fe80::9c48:feff:fe93:c1b5', 'fe80::fc16:3eff:fea8:11d0', 'fe80::fc16:3eff:fee3:c3ae', 'fe80::fc16:3eff:feb7:f38b', 'fe80::fc16:3eff:fe80:4c19', 'fe80::fc16:3eff:fe23:5890', 'fe80::d88b:eeff:fe9b:9ecb', 'fe80::fc16:3eff:fe60:419', 'fe80::c4cf:61ff:fe10:8573', 'fe80::fc16:3eff:fe52:40dc', 'fe80::ec6a:1ff:fe54:5dbf', 'fe80::fc16:3eff:fe5e:4e78', 'fe80::fc16:3eff:fe2e:c45e', 'fe80::b499:daff:fe68:cfe4', 'fe80::fc16:3eff:fe82:2b99'] Jun 03 01:07:29.462604 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:07:29.462767 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:07:29.463138 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:07:29.463569 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Updating existing volume attachment record: b7383791-96d4-4153-87ec-808c235ba9f4 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:07:29.479037 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:29.530932 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-7e2130ad-5050-4448-8fa1-33bd58ef40a9 req-6b726aea-4b7c-4329-b7d0-1da3f6c93675 service nova] Releasing lock "refresh_cache-0584c6a8-64fc-4891-ba12-b8ede4275b95" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:29.550034 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Removed pending STOPPED event for 02e31daf-9f87-4574-be4b-3ed12bd8f050 due to new event Resumed> {{(pid=98288) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 03 01:07:29.550281 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:29.551110 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] VM Resumed (Lifecycle Event) Jun 03 01:07:29.555924 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-1369053b-8fb8-4519-a22d-c310dc897266 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:30.033083 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:07:30.033540 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:07:30.033743 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:30.034495 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:30.034760 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:07:30.056240 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:30.056774 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:30.057319 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:30.057593 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:07:30.059889 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:30.059889 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:30.059889 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:07:30.061320 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:30.079307 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:07:30.079307 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:30.086057 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:07:30.086057 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:30.095036 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42] added Jun 03 01:07:30.095036 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:07:30.095036 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:07:30.095036 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:07:30.095036 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:07:30.095036 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:07:30.095036 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:30.098464 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:07:30.098464 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.04(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:07:30.098464 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:07:30.105654 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42] added Jun 03 01:07:30.105654 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:07:30.105654 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:07:30.105654 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:07:30.105654 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:07:30.105654 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:07:30.105654 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:30.106012 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:07:30.106073 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0467(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:07:30.106209 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:07:30.257097 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received event network-vif-plugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:30.257682 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] Acquiring lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:30.258047 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:30.258343 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:30.259692 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] No waiting events found dispatching network-vif-plugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:30.259692 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received unexpected event network-vif-plugged-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 for instance with vm_state active and task_state deleting. Jun 03 01:07:30.259692 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received event network-vif-plugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:30.259692 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] Acquiring lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:30.259692 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:30.259692 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:30.260300 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Processing event network-vif-plugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:07:30.260627 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received event network-vif-plugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:30.261510 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Instance event wait completed in 6 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:07:30.261748 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] Acquiring lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:30.262074 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:30.262924 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:30.262924 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] No waiting events found dispatching network-vif-plugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:30.262924 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-8a76ec46-ada5-4829-8b72-88aaa3ed2b15 req-429f4b09-01bd-43e2-b2fb-837c7afd48fb service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received unexpected event network-vif-plugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 for instance with vm_state building and task_state spawning. Jun 03 01:07:30.267165 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:07:30.270875 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Instance spawned successfully. Jun 03 01:07:30.271649 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:07:30.569687 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:30.569869 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] VM Started (Lifecycle Event) Jun 03 01:07:30.659389 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "02e31daf-9f87-4574-be4b-3ed12bd8f050" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:30.659522 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:30.660079 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:30.660079 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:30.660079 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:30.662028 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Terminating instance Jun 03 01:07:30.712026 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:30.712220 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:30.780512 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:30.780656 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:30.781526 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:30.781601 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:30.782184 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:30.782579 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:31.072158 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:31.073406 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:31.098227 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:07:31.107046 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:07:31.113853 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:07:31.125478 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:31.130203 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:31.140723 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b04c3562-da2a-44ff-9b55-cbe1bc60d90d (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.149692 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b04c3562-da2a-44ff-9b55-cbe1bc60d90d (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.150312 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:31.165553 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b04c3562-da2a-44ff-9b55-cbe1bc60d90d (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.169613 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b04c3562-da2a-44ff-9b55-cbe1bc60d90d (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.170252 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:31.200339 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:31.211967 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42, portal: 192.168.40.100,3260] Jun 03 01:07:31.211967 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42, portal: 192.168.40.100,3260] successful. Jun 03 01:07:31.211967 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:31.215634 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:07:31.227412 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:31.237971 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:31.238943 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42, portal: 192.168.50.100,3260] Jun 03 01:07:31.238943 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42, portal: 192.168.50.100,3260] successful. Jun 03 01:07:31.238943 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:31.251571 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b04c3562-da2a-44ff-9b55-cbe1bc60d90d (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b04c3562-da2a-44ff-9b55-cbe1bc60d90d (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.263347 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:31.264490 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:31.264490 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:07:31.266178 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] HCTL ('22', '-', '-', 0) found on session 38 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:07:31.266273 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Searching for a device in session 38 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b04c3562-da2a-44ff-9b55-cbe1bc60d90d (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b04c3562-da2a-44ff-9b55-cbe1bc60d90d (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:31.286141 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:07:31.289408 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Took 13.58 seconds to spawn the instance on the hypervisor. Jun 03 01:07:31.289611 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:31.290587 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] HCTL ('23', '-', '-', 0) found on session 39 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:07:31.290587 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:07:31.311240 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Searching for a device in session 39 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:07:31.311240 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:07:31.423447 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:31.431760 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:31.560039 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Instance destroyed successfully. Jun 03 01:07:31.560847 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'resources' on Instance uuid 02e31daf-9f87-4574-be4b-3ed12bd8f050 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:31.576475 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] During sync_power_state the instance has a pending task (deleting). Skip. Jun 03 01:07:31.576982 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:31.577139 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] VM Resumed (Lifecycle Event) Jun 03 01:07:31.808059 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Took 21.38 seconds to build instance. Jun 03 01:07:31.922367 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:31.925796 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:31.928943 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:07:31.929108 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Claim successful on node np0000002000 Jun 03 01:07:32.058217 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:07:32.066372 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-371005072',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-371005072',id=17,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-03T01:07:23Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-iub9iwve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:30Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=02e31daf-9f87-4574-be4b-3ed12bd8f050,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:07:32.066372 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "address": "fa:16:3e:82:2b:99", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2016ef2-49", "ovs_interfaceid": "d2016ef2-49b4-4aa3-bdc8-f0bef07c6901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:32.066372 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=d2016ef2-49b4-4aa3-bdc8-f0bef07c6901,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2016ef2-49') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:32.068652 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=d2016ef2-49b4-4aa3-bdc8-f0bef07c6901,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2016ef2-49') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:07:32.069368 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:32.069624 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2016ef2-49, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:32.071179 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:32.072191 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:32.073565 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:32.075248 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:32.075248 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b2d0dcf-92f9-456d-ade1-bfc836213404) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:32.075248 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:32.075987 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:32.078065 np0000002000 nova-compute[98288]: INFO os_vif [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:2b:99,bridge_name='br-int',has_traffic_filtering=True,id=d2016ef2-49b4-4aa3-bdc8-f0bef07c6901,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2016ef2-49') Jun 03 01:07:32.081544 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:32.081544 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:07:32.081544 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:07:32.081544 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:32.085692 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:32.309639 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 22.895s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:32.516238 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-1e189b74-6896-4948-b55e-e9cd668b0417 req-93d500b0-7709-4090-b1cb-63b995590a65 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received event network-changed-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:32.517569 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-1e189b74-6896-4948-b55e-e9cd668b0417 req-93d500b0-7709-4090-b1cb-63b995590a65 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Refreshing instance network info cache due to event network-changed-49f6412d-4366-42e3-a2f7-19a20cc8c032. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:07:32.517569 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-1e189b74-6896-4948-b55e-e9cd668b0417 req-93d500b0-7709-4090-b1cb-63b995590a65 service nova] Acquiring lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:32.517569 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-1e189b74-6896-4948-b55e-e9cd668b0417 req-93d500b0-7709-4090-b1cb-63b995590a65 service nova] Acquired lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:32.517569 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-1e189b74-6896-4948-b55e-e9cd668b0417 req-93d500b0-7709-4090-b1cb-63b995590a65 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Refreshing network info cache for port 49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:07:32.592542 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999745196000049 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:32.895974 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:32.981494 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Refreshing inventories for resource provider e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}} Jun 03 01:07:33.021956 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-1e189b74-6896-4948-b55e-e9cd668b0417 req-93d500b0-7709-4090-b1cb-63b995590a65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:33.025679 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Updating ProviderTree inventory for provider e5e0d48c-b64b-4e03-864c-efd360069abb from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}} Jun 03 01:07:33.025866 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Updating inventory in ProviderTree for provider e5e0d48c-b64b-4e03-864c-efd360069abb with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 03 01:07:33.075349 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Found WWN 330000000aae5304d for multipath device dm-13 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:07:33.075785 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:33.075914 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000aae5304d', 'path': '/dev/dm-13', 'multipath_id': '330000000aae5304d'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:07:33.076088 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000aae5304d', 'path': '/dev/dm-13', 'multipath_id': '330000000aae5304d'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:07:33.076595 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.996s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:33.077538 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19696d01-3935-4ef0-b689-6591e9ad42e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:07:33.077978 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:07:33.082300 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lazy-loading 'flavor' on Instance uuid d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:33.087892 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Refreshing aggregate associations for resource provider e5e0d48c-b64b-4e03-864c-efd360069abb, aggregates: None {{(pid=98288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}} Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b04c3562-da2a-44ff-9b55-cbe1bc60d90d (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b04c3562-da2a-44ff-9b55-cbe1bc60d90d (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b04c3562-da2a-44ff-9b55-cbe1bc60d90d', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:07:33.127466 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', '30')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:07:33.128417 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7', '29')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:07:33.128583 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Resulting device map defaultdict(. at 0x73e794271440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7'): ({'sdf'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:07:33.128782 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Removing multipathed devices sdf, sdg {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:07:33.128994 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flush multipath device 3300000006583efdf {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:07:33.148074 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Refreshing trait associations for resource provider e5e0d48c-b64b-4e03-864c-efd360069abb, traits: HW_CPU_X86_SSE,COMPUTE_ARCH_PPC64LE,COMPUTE_ARCH_MIPSEL,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_ARCH_AARCH64,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_ARCH_S390X,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_ARCH_RISCV64,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_ARCH_X86_64,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ARCH_X86_64,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42,COMPUTE_SOUND_MODEL_AC97,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_SOUND_MODEL_SB16,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_USB,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_IGB {{(pid=98288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}} Jun 03 01:07:33.176145 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:07:33.215771 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:07:33.283244 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:07:33.283414 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:07:33.285040 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:07:33.296817 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:07:33.297245 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:07:33.313284 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:33.361662 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7, portal: 192.168.40.100,3260] Jun 03 01:07:33.361662 np0000002000 nova-compute[98288]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7, portal: 192.168.40.100,3260] successful. Jun 03 01:07:33.361662 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:33.396174 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:33.407366 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:33.450180 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7, portal: 192.168.50.100,3260] Jun 03 01:07:33.450180 np0000002000 nova-compute[98288]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-19696d01-3935-4ef0-b689-6591e9ad42e7, portal: 192.168.50.100,3260] successful. Jun 03 01:07:33.450180 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:33.469786 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-1e189b74-6896-4948-b55e-e9cd668b0417 req-93d500b0-7709-4090-b1cb-63b995590a65 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:33.486204 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:33.486513 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:33.486706 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] <== disconnect_volume: return (1407ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:07:33.486871 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:07:33.487131 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Deleting instance files /opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050_del Jun 03 01:07:33.487634 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Deletion of /opt/stack/data/nova/instances/02e31daf-9f87-4574-be4b-3ed12bd8f050_del complete Jun 03 01:07:33.585666 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Attempting to attach volume ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98288) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 03 01:07:33.586753 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] attach device xml: Jun 03 01:07:33.586753 np0000002000 nova-compute[98288]: Jun 03 01:07:33.586753 np0000002000 nova-compute[98288]: Jun 03 01:07:33.586753 np0000002000 nova-compute[98288]: Jun 03 01:07:33.586753 np0000002000 nova-compute[98288]: Jun 03 01:07:33.586753 np0000002000 nova-compute[98288]: ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 Jun 03 01:07:33.586753 np0000002000 nova-compute[98288]: Jun 03 01:07:33.586753 np0000002000 nova-compute[98288]: {{(pid=98288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 03 01:07:33.645572 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-1e189b74-6896-4948-b55e-e9cd668b0417 req-93d500b0-7709-4090-b1cb-63b995590a65 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Updated VIF entry in instance network info cache for port 49f6412d-4366-42e3-a2f7-19a20cc8c032. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:07:33.646111 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-1e189b74-6896-4948-b55e-e9cd668b0417 req-93d500b0-7709-4090-b1cb-63b995590a65 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Updating instance_info_cache with network_info: [{"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:33.834243 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:07:33.834502 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:07:33.993500 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Took 2.83 seconds to destroy the instance on the hypervisor. Jun 03 01:07:33.994199 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:07:33.995109 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:07:33.995223 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:07:33.995467 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:34.050421 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:34.148276 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-1e189b74-6896-4948-b55e-e9cd668b0417 req-93d500b0-7709-4090-b1cb-63b995590a65 service nova] Releasing lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:34.339937 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:07:34.597225 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-79997267-59c6-48d1-8f39-6db12ae635c4 req-26da955f-7068-43c4-b162-62e9943f3147 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Received event network-vif-deleted-d2016ef2-49b4-4aa3-bdc8-f0bef07c6901 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:34.601160 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-79997267-59c6-48d1-8f39-6db12ae635c4 req-26da955f-7068-43c4-b162-62e9943f3147 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Neutron deleted interface d2016ef2-49b4-4aa3-bdc8-f0bef07c6901; detaching it from the instance and deleting it from the info cache Jun 03 01:07:34.602424 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-79997267-59c6-48d1-8f39-6db12ae635c4 req-26da955f-7068-43c4-b162-62e9943f3147 service nova] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Detach interface failed, port_id=d2016ef2-49b4-4aa3-bdc8-f0bef07c6901, reason: Instance 02e31daf-9f87-4574-be4b-3ed12bd8f050 could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:07:34.794470 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:34.851032 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.928s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:34.851596 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:07:35.243013 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:35.243324 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:35.243398 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:35.243534 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] No VIF found with MAC fa:16:3e:25:b7:2e, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:07:35.295631 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Took 1.30 seconds to deallocate network for instance. Jun 03 01:07:35.359198 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:07:35.359612 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:07:35.359880 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:35.360125 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:35.431565 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8092b0179794edf9ce6d802adc8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52af3a46de7498c8225030529c1d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:07:35.862071 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Took 0.56 seconds to detach 1 volumes for instance. Jun 03 01:07:35.863895 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Deleting volume: 19696d01-3935-4ef0-b689-6591e9ad42e7 {{(pid=98288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}} Jun 03 01:07:35.867412 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:07:35.970349 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Successfully created port: 0ff7144f-d5a9-47c6-9020-ee801a5b02d5 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:07:36.379404 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:07:36.425345 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:36.425345 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:36.541941 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Successfully updated port: 0ff7144f-d5a9-47c6-9020-ee801a5b02d5 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:07:36.623078 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5df056b9-a4bc-4fcf-8e54-feb0657f5c11 req-8c71313e-8930-45a5-842d-2be2d6e88a44 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Received event network-changed-0ff7144f-d5a9-47c6-9020-ee801a5b02d5 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:36.623245 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5df056b9-a4bc-4fcf-8e54-feb0657f5c11 req-8c71313e-8930-45a5-842d-2be2d6e88a44 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Refreshing instance network info cache due to event network-changed-0ff7144f-d5a9-47c6-9020-ee801a5b02d5. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:07:36.623405 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5df056b9-a4bc-4fcf-8e54-feb0657f5c11 req-8c71313e-8930-45a5-842d-2be2d6e88a44 service nova] Acquiring lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:36.623527 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5df056b9-a4bc-4fcf-8e54-feb0657f5c11 req-8c71313e-8930-45a5-842d-2be2d6e88a44 service nova] Acquired lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:36.623642 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-5df056b9-a4bc-4fcf-8e54-feb0657f5c11 req-8c71313e-8930-45a5-842d-2be2d6e88a44 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Refreshing network info cache for port 0ff7144f-d5a9-47c6-9020-ee801a5b02d5 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:07:36.829605 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0002a086-ae55-4e9b-a252-aec9f6028c78 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.501s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:37.044777 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:37.075781 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:37.127986 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-5df056b9-a4bc-4fcf-8e54-feb0657f5c11 req-8c71313e-8930-45a5-842d-2be2d6e88a44 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:37.133525 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:07:37.133855 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:07:37.215737 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-5df056b9-a4bc-4fcf-8e54-feb0657f5c11 req-8c71313e-8930-45a5-842d-2be2d6e88a44 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:07:37.392039 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:07:37.393080 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:07:37.393356 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Creating image(s) Jun 03 01:07:37.393856 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "/opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:37.394036 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "/opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:37.394727 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "/opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:37.395326 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:37.400212 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:37.403146 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:37.434079 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-5df056b9-a4bc-4fcf-8e54-feb0657f5c11 req-8c71313e-8930-45a5-842d-2be2d6e88a44 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:37.498526 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.095s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:37.498970 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:37.499401 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:37.500201 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:37.503187 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:37.503616 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:37.591477 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.085s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:37.591477 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:37.639480 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:07:37.645099 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk 1073741824" returned: 0 in 0.055s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:37.645968 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.146s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:37.646356 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:37.725211 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.078s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:37.725794 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:07:37.726089 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:37.828799 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:37.829317 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Cannot resize image /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:07:37.829832 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:07:37.830085 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Ensure instance console log exists: /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:07:37.830422 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:37.830749 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:37.830935 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:37.916166 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:37.941030 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5df056b9-a4bc-4fcf-8e54-feb0657f5c11 req-8c71313e-8930-45a5-842d-2be2d6e88a44 service nova] Releasing lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:37.941264 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquired lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:37.941553 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:07:38.147873 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.723s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:38.215598 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Deleted allocations for instance 02e31daf-9f87-4574-be4b-3ed12bd8f050 Jun 03 01:07:38.524331 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:07:38.711852 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:38.843050 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Updating instance_info_cache with network_info: [{"id": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "address": "fa:16:3e:0b:6e:2b", "network": {"id": "246d6702-1aae-400a-8fff-b9cf129f6aeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145522194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff7144f-d5", "ovs_interfaceid": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:39.031486 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:39.031756 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:39.227288 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2bb4d263-2a05-4912-ada4-dbe21bf64bc1 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "02e31daf-9f87-4574-be4b-3ed12bd8f050" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.568s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:39.345330 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Releasing lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:39.345639 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Instance network_info: |[{"id": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "address": "fa:16:3e:0b:6e:2b", "network": {"id": "246d6702-1aae-400a-8fff-b9cf129f6aeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145522194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff7144f-d5", "ovs_interfaceid": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:07:39.347091 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Start _get_guest_xml network_info=[{"id": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "address": "fa:16:3e:0b:6e:2b", "network": {"id": "246d6702-1aae-400a-8fff-b9cf129f6aeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145522194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff7144f-d5", "ovs_interfaceid": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:07:39.350070 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:07:39.351255 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-565619882', uuid='6eefbe1c-468b-4294-9f24-7cc661bb3df2'), owner=OwnerMeta(userid='e8092b0179794edf9ce6d802adc8cc8f', username='tempest-TaggedAttachmentsTest-1125506206-project-member', projectid='f52af3a46de7498c8225030529c1d868', projectname='tempest-TaggedAttachmentsTest-1125506206'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "address": "fa:16:3e:0b:6e:2b", "network": {"id": "246d6702-1aae-400a-8fff-b9cf129f6aeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145522194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff7144f-d5", "ovs_interfaceid": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448859.3509183) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:07:39.352516 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:07:39.352910 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:07:39.354119 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:07:39.354309 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:07:39.355136 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:07:39.355422 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:07:39.355583 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:07:39.355668 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:07:39.355785 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:07:39.355862 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:07:39.355951 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:07:39.356096 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:07:39.356190 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:07:39.356291 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:07:39.356384 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:07:39.356532 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:07:39.367213 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:07:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-565619882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-565619882',id=19,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbZ9pKZxlPAaSnxNpNutFnQbBi3kuyPB49DYd+gGlDINebjgMkgajEvEz+1OvuZiqu1lqqUbr7htvJLcQVd34/M9wOa/5NMz3tTbdndj/0vW5a6CvOsqaq3g7g+PdObvA==',key_name='tempest-keypair-1816886568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f52af3a46de7498c8225030529c1d868',ramdisk_id='',reservation_id='r-55wspc0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1125506206',owner_user_name='tempest-TaggedAttachmentsTest-1125506206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8092b0179794edf9ce6d802adc8cc8f',uuid=6eefbe1c-468b-4294-9f24-7cc661bb3df2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "address": "fa:16:3e:0b:6e:2b", "network": {"id": "246d6702-1aae-400a-8fff-b9cf129f6aeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145522194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff7144f-d5", "ovs_interfaceid": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:07:39.367383 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Converting VIF {"id": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "address": "fa:16:3e:0b:6e:2b", "network": {"id": "246d6702-1aae-400a-8fff-b9cf129f6aeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145522194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff7144f-d5", "ovs_interfaceid": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:39.367917 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:6e:2b,bridge_name='br-int',has_traffic_filtering=True,id=0ff7144f-d5a9-47c6-9020-ee801a5b02d5,network=Network(246d6702-1aae-400a-8fff-b9cf129f6aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ff7144f-d5') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:39.368420 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lazy-loading 'pci_devices' on Instance uuid 6eefbe1c-468b-4294-9f24-7cc661bb3df2 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:39.535887 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] End _get_guest_xml xml= Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 6eefbe1c-468b-4294-9f24-7cc661bb3df2 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: instance-00000013 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 196608 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: tempest-device-tagging-server-565619882 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 2026-06-03 01:07:39 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 192 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: True Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: bare Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: virtio Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: tempest-TaggedAttachmentsTest-1125506206-project-member Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: tempest-TaggedAttachmentsTest-1125506206 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 6eefbe1c-468b-4294-9f24-7cc661bb3df2 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 6eefbe1c-468b-4294-9f24-7cc661bb3df2 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: hvm Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 128 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: Jun 03 01:07:39.870792 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:07:39.873531 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Preparing to wait for external event network-vif-plugged-0ff7144f-d5a9-47c6-9020-ee801a5b02d5 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:07:39.873531 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:39.873531 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:39.873531 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:39.873531 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:07:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-565619882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-565619882',id=19,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbZ9pKZxlPAaSnxNpNutFnQbBi3kuyPB49DYd+gGlDINebjgMkgajEvEz+1OvuZiqu1lqqUbr7htvJLcQVd34/M9wOa/5NMz3tTbdndj/0vW5a6CvOsqaq3g7g+PdObvA==',key_name='tempest-keypair-1816886568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f52af3a46de7498c8225030529c1d868',ramdisk_id='',reservation_id='r-55wspc0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1125506206',owner_user_name='tempest-TaggedAttachmentsTest-1125506206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8092b0179794edf9ce6d802adc8cc8f',uuid=6eefbe1c-468b-4294-9f24-7cc661bb3df2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "address": "fa:16:3e:0b:6e:2b", "network": {"id": "246d6702-1aae-400a-8fff-b9cf129f6aeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145522194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff7144f-d5", "ovs_interfaceid": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:07:39.873531 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Converting VIF {"id": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "address": "fa:16:3e:0b:6e:2b", "network": {"id": "246d6702-1aae-400a-8fff-b9cf129f6aeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145522194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff7144f-d5", "ovs_interfaceid": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:39.873531 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:6e:2b,bridge_name='br-int',has_traffic_filtering=True,id=0ff7144f-d5a9-47c6-9020-ee801a5b02d5,network=Network(246d6702-1aae-400a-8fff-b9cf129f6aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ff7144f-d5') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:39.876055 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:6e:2b,bridge_name='br-int',has_traffic_filtering=True,id=0ff7144f-d5a9-47c6-9020-ee801a5b02d5,network=Network(246d6702-1aae-400a-8fff-b9cf129f6aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ff7144f-d5') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:07:39.876503 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:39.876786 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:39.877047 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:07:39.879125 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:39.879281 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4a0ef60-cef3-5777-90a7-20a029ce2650', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:39.880133 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:39.881152 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:39.882638 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:39.885645 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:39.885826 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ff7144f-d5, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:39.886092 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ff7144f-d5, col_values=(('qos', UUID('d54bce52-a36a-4bfc-afeb-f9e0a775f7e5')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:39.886249 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ff7144f-d5, col_values=(('external_ids', {'iface-id': '0ff7144f-d5a9-47c6-9020-ee801a5b02d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:6e:2b', 'vm-uuid': '6eefbe1c-468b-4294-9f24-7cc661bb3df2'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:39.887265 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:39.888327 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:39.896411 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:39.897297 np0000002000 nova-compute[98288]: INFO os_vif [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:6e:2b,bridge_name='br-int',has_traffic_filtering=True,id=0ff7144f-d5a9-47c6-9020-ee801a5b02d5,network=Network(246d6702-1aae-400a-8fff-b9cf129f6aeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ff7144f-d5') Jun 03 01:07:40.156557 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:40.158605 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:40.180520 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:07:40.181213 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Claim successful on node np0000002000 Jun 03 01:07:40.724282 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "71626a81-876a-40b9-ae4f-a57455bf345b" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:40.724768 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "71626a81-876a-40b9-ae4f-a57455bf345b" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:40.724768 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:40.724905 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:40.724905 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:40.727464 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Terminating instance Jun 03 01:07:41.231839 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:07:41.266512 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:41.272374 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:41.303782 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:41.415778 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:41.415778 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:41.415778 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] No VIF found with MAC fa:16:3e:0b:6e:2b, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:07:41.415999 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Using config drive Jun 03 01:07:41.458660 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:41.464788 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:41.470787 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-85fe1633-f834-4867-8deb-a1bddeb627eb req-3ebb2c7a-d573-4b11-96f6-10e54f128a62 service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Received event network-vif-unplugged-08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:41.470994 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-85fe1633-f834-4867-8deb-a1bddeb627eb req-3ebb2c7a-d573-4b11-96f6-10e54f128a62 service nova] Acquiring lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:41.471152 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-85fe1633-f834-4867-8deb-a1bddeb627eb req-3ebb2c7a-d573-4b11-96f6-10e54f128a62 service nova] Lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:41.471324 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-85fe1633-f834-4867-8deb-a1bddeb627eb req-3ebb2c7a-d573-4b11-96f6-10e54f128a62 service nova] Lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:41.471496 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-85fe1633-f834-4867-8deb-a1bddeb627eb req-3ebb2c7a-d573-4b11-96f6-10e54f128a62 service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] No waiting events found dispatching network-vif-unplugged-08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:41.471793 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-85fe1633-f834-4867-8deb-a1bddeb627eb req-3ebb2c7a-d573-4b11-96f6-10e54f128a62 service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Received event network-vif-unplugged-08eb504a-2b3a-4306-bca5-2cd861bcf959 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:41.575363 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999727123999946 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:41.576722 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Instance destroyed successfully. Jun 03 01:07:41.576951 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'resources' on Instance uuid 71626a81-876a-40b9-ae4f-a57455bf345b {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:41.901263 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:07:41.902524 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:07:41.920911 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:42.054751 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Creating config drive at /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk.config Jun 03 01:07:42.060328 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3lbdg8ox {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:42.084310 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1880386759',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-1880386759',id=14,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-03T01:06:31Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-pz33immf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:06:39Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=71626a81-876a-40b9-ae4f-a57455bf345b,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "address": "fa:16:3e:6f:53:ec", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08eb504a-2b", "ovs_interfaceid": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:07:42.085089 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "address": "fa:16:3e:6f:53:ec", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap08eb504a-2b", "ovs_interfaceid": "08eb504a-2b3a-4306-bca5-2cd861bcf959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:42.086553 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:53:ec,bridge_name='br-int',has_traffic_filtering=True,id=08eb504a-2b3a-4306-bca5-2cd861bcf959,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08eb504a-2b') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:42.086990 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:53:ec,bridge_name='br-int',has_traffic_filtering=True,id=08eb504a-2b3a-4306-bca5-2cd861bcf959,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08eb504a-2b') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:07:42.089736 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:42.090076 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08eb504a-2b, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:42.091889 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:42.094104 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:42.097348 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:42.098999 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:42.099302 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30791a9f-8a58-45f2-84d1-099a49f45b9d) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:42.100559 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:42.101871 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:42.106318 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:42.108582 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3lbdg8ox" returned: 0 in 0.048s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:42.111896 np0000002000 nova-compute[98288]: INFO os_vif [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:53:ec,bridge_name='br-int',has_traffic_filtering=True,id=08eb504a-2b3a-4306-bca5-2cd861bcf959,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08eb504a-2b') Jun 03 01:07:42.112248 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Deleting instance files /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b_del Jun 03 01:07:42.113014 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Deletion of /opt/stack/data/nova/instances/71626a81-876a-40b9-ae4f-a57455bf345b_del complete Jun 03 01:07:42.406557 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:07:42.541492 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:42.576544 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:42.579646 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:42.620084 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Took 1.39 seconds to destroy the instance on the hypervisor. Jun 03 01:07:42.620897 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:07:42.621330 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:07:42.621428 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:07:42.621791 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:42.666767 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:42.701511 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:42.760388 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-19f40c59-c3b2-4ea0-a224-6d56ee07aad9 req-aa3915ce-9840-48a7-b525-01aad850c68f service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Received event network-vif-plugged-0ff7144f-d5a9-47c6-9020-ee801a5b02d5 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:42.762489 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-19f40c59-c3b2-4ea0-a224-6d56ee07aad9 req-aa3915ce-9840-48a7-b525-01aad850c68f service nova] Acquiring lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:42.762489 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-19f40c59-c3b2-4ea0-a224-6d56ee07aad9 req-aa3915ce-9840-48a7-b525-01aad850c68f service nova] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:42.762489 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-19f40c59-c3b2-4ea0-a224-6d56ee07aad9 req-aa3915ce-9840-48a7-b525-01aad850c68f service nova] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:42.762489 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-19f40c59-c3b2-4ea0-a224-6d56ee07aad9 req-aa3915ce-9840-48a7-b525-01aad850c68f service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Processing event network-vif-plugged-0ff7144f-d5a9-47c6-9020-ee801a5b02d5 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:07:42.917548 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.759s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:42.918075 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:07:42.926125 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:42.959566 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:42.962929 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:43.170474 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0009224099999300961 future=) was cancelled during its delay period, skipping {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:43.170674 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:43.170787 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=4.42137995600001 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:43.170873 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=4.421290714999941 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:43.425276 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:43.425636 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:07:43.425786 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] VM Started (Lifecycle Event) Jun 03 01:07:43.429141 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:07:43.431292 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Instance spawned successfully. Jun 03 01:07:43.431835 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:07:43.437404 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:07:43.438035 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:07:43.438523 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:43.439494 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:43.537962 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-dc8f8d79-a28e-481e-80ab-d6ece0bafa3b req-f4f902af-1805-4b96-b222-12ddca09f06c service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Received event network-vif-unplugged-08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:43.538172 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-dc8f8d79-a28e-481e-80ab-d6ece0bafa3b req-f4f902af-1805-4b96-b222-12ddca09f06c service nova] Acquiring lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:43.540450 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-dc8f8d79-a28e-481e-80ab-d6ece0bafa3b req-f4f902af-1805-4b96-b222-12ddca09f06c service nova] Lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:43.540630 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-dc8f8d79-a28e-481e-80ab-d6ece0bafa3b req-f4f902af-1805-4b96-b222-12ddca09f06c service nova] Lock "71626a81-876a-40b9-ae4f-a57455bf345b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:43.540762 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-dc8f8d79-a28e-481e-80ab-d6ece0bafa3b req-f4f902af-1805-4b96-b222-12ddca09f06c service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] No waiting events found dispatching network-vif-unplugged-08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:43.541590 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-dc8f8d79-a28e-481e-80ab-d6ece0bafa3b req-f4f902af-1805-4b96-b222-12ddca09f06c service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Received event network-vif-unplugged-08eb504a-2b3a-4306-bca5-2cd861bcf959 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:43.543916 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4586ad9e4c304b0fa9a960267667ac64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e01380196548bbbe8f5f9e9147494b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:07:43.640198 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:43.927979 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:43.929301 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:43.937713 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:43.937985 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:43.939713 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:07:43.946636 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:43.947097 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:43.947537 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:43.948168 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:44.027589 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Successfully created port: 0a5f107a-eb9e-40bc-8054-427935e6421e {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:07:44.141945 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Took 1.52 seconds to deallocate network for instance. Jun 03 01:07:44.431622 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:07:44.432020 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:44.432197 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] VM Paused (Lifecycle Event) Jun 03 01:07:44.452624 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:07:44.456063 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Took 7.06 seconds to spawn the instance on the hypervisor. Jun 03 01:07:44.456252 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:44.567518 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Successfully updated port: 0a5f107a-eb9e-40bc-8054-427935e6421e {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:07:44.653033 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:44.653303 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:44.840265 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-882a9ff1-81ba-4d2b-a5b1-87e74d65f4dc req-3e47b533-36ce-4677-8136-c0723efb44d1 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Received event network-vif-plugged-0ff7144f-d5a9-47c6-9020-ee801a5b02d5 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:44.840487 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-882a9ff1-81ba-4d2b-a5b1-87e74d65f4dc req-3e47b533-36ce-4677-8136-c0723efb44d1 service nova] Acquiring lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:44.841302 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-882a9ff1-81ba-4d2b-a5b1-87e74d65f4dc req-3e47b533-36ce-4677-8136-c0723efb44d1 service nova] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:44.841302 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-882a9ff1-81ba-4d2b-a5b1-87e74d65f4dc req-3e47b533-36ce-4677-8136-c0723efb44d1 service nova] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:44.841302 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-882a9ff1-81ba-4d2b-a5b1-87e74d65f4dc req-3e47b533-36ce-4677-8136-c0723efb44d1 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] No waiting events found dispatching network-vif-plugged-0ff7144f-d5a9-47c6-9020-ee801a5b02d5 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:44.841577 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-882a9ff1-81ba-4d2b-a5b1-87e74d65f4dc req-3e47b533-36ce-4677-8136-c0723efb44d1 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Received unexpected event network-vif-plugged-0ff7144f-d5a9-47c6-9020-ee801a5b02d5 for instance with vm_state active and task_state None. Jun 03 01:07:44.841577 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-882a9ff1-81ba-4d2b-a5b1-87e74d65f4dc req-3e47b533-36ce-4677-8136-c0723efb44d1 service nova] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Received event network-vif-deleted-08eb504a-2b3a-4306-bca5-2cd861bcf959 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:44.935407 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:44.937271 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:44.937396 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] VM Resumed (Lifecycle Event) Jun 03 01:07:44.977210 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Took 13.26 seconds to build instance. Jun 03 01:07:45.071467 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "refresh_cache-0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:45.071644 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquired lock "refresh_cache-0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:45.071771 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:07:45.227234 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:07:45.227414 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:07:45.440780 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:45.443757 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:45.467085 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:07:45.471344 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:07:45.471605 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Creating image(s) Jun 03 01:07:45.472071 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:45.472233 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "/opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:45.472668 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "/opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:45.473136 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:45.481088 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-2e57e5a6-d191-4e65-a5d6-6b59f2a75ee7 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 14.769s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:45.482099 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:45.483250 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:45.562803 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.079s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:45.563215 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:45.563682 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:45.564185 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:45.568299 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:45.568623 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:45.635375 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-10efe6ec-dec8-43e0-9154-3dfcca133924 req-23e2694a-e0cb-4bae-afe4-bb9aaf4fb1da service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Received event network-changed-0a5f107a-eb9e-40bc-8054-427935e6421e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:45.637745 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-10efe6ec-dec8-43e0-9154-3dfcca133924 req-23e2694a-e0cb-4bae-afe4-bb9aaf4fb1da service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Refreshing instance network info cache due to event network-changed-0a5f107a-eb9e-40bc-8054-427935e6421e. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:07:45.637982 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-10efe6ec-dec8-43e0-9154-3dfcca133924 req-23e2694a-e0cb-4bae-afe4-bb9aaf4fb1da service nova] Acquiring lock "refresh_cache-0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:45.651315 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.083s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:45.652405 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:45.674150 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:07:45.702508 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk 1073741824" returned: 0 in 0.050s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:45.702887 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.139s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:45.703208 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:45.731651 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:07:45.792861 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.089s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:45.793200 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:07:45.793423 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:45.864304 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:45.872313 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:45.872711 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:45.872711 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:45.872858 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:45.873208 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:45.879093 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Terminating instance Jun 03 01:07:45.884365 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:45.886614 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Cannot resize image /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:07:45.887022 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:07:45.887267 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Ensure instance console log exists: /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:07:45.887744 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:45.887945 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:45.888122 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:46.018921 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Updating instance_info_cache with network_info: [{"id": "0a5f107a-eb9e-40bc-8054-427935e6421e", "address": "fa:16:3e:b0:f1:fd", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5f107a-eb", "ovs_interfaceid": "0a5f107a-eb9e-40bc-8054-427935e6421e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:46.244861 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.592s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:46.299336 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c1219592-35c0-47e5-a5e0-13dfd005aca9 req-6f0579fc-22da-49f0-9870-c798f5788622 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Received event network-changed-0ff7144f-d5a9-47c6-9020-ee801a5b02d5 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:46.301668 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c1219592-35c0-47e5-a5e0-13dfd005aca9 req-6f0579fc-22da-49f0-9870-c798f5788622 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Refreshing instance network info cache due to event network-changed-0ff7144f-d5a9-47c6-9020-ee801a5b02d5. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:07:46.301889 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c1219592-35c0-47e5-a5e0-13dfd005aca9 req-6f0579fc-22da-49f0-9870-c798f5788622 service nova] Acquiring lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:46.302137 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c1219592-35c0-47e5-a5e0-13dfd005aca9 req-6f0579fc-22da-49f0-9870-c798f5788622 service nova] Acquired lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:46.302259 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-c1219592-35c0-47e5-a5e0-13dfd005aca9 req-6f0579fc-22da-49f0-9870-c798f5788622 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Refreshing network info cache for port 0ff7144f-d5a9-47c6-9020-ee801a5b02d5 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:07:46.327832 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Deleted allocations for instance 71626a81-876a-40b9-ae4f-a57455bf345b Jun 03 01:07:46.389596 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:07:46.413771 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.418508 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.440357 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.459988 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.480199 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.508379 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.514469 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.521636 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Releasing lock "refresh_cache-0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:46.522504 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Instance network_info: |[{"id": "0a5f107a-eb9e-40bc-8054-427935e6421e", "address": "fa:16:3e:b0:f1:fd", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5f107a-eb", "ovs_interfaceid": "0a5f107a-eb9e-40bc-8054-427935e6421e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:07:46.522504 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-10efe6ec-dec8-43e0-9154-3dfcca133924 req-23e2694a-e0cb-4bae-afe4-bb9aaf4fb1da service nova] Acquired lock "refresh_cache-0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:46.522756 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-10efe6ec-dec8-43e0-9154-3dfcca133924 req-23e2694a-e0cb-4bae-afe4-bb9aaf4fb1da service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Refreshing network info cache for port 0a5f107a-eb9e-40bc-8054-427935e6421e {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:07:46.528481 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Start _get_guest_xml network_info=[{"id": "0a5f107a-eb9e-40bc-8054-427935e6421e", "address": "fa:16:3e:b0:f1:fd", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5f107a-eb", "ovs_interfaceid": "0a5f107a-eb9e-40bc-8054-427935e6421e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:07:46.540297 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:07:46.542111 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-394889113', uuid='0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7'), owner=OwnerMeta(userid='4586ad9e4c304b0fa9a960267667ac64', username='tempest-AttachVolumeNegativeTest-1145310491-project-member', projectid='88e01380196548bbbe8f5f9e9147494b', projectname='tempest-AttachVolumeNegativeTest-1145310491'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0a5f107a-eb9e-40bc-8054-427935e6421e", "address": "fa:16:3e:b0:f1:fd", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5f107a-eb", "ovs_interfaceid": "0a5f107a-eb9e-40bc-8054-427935e6421e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448866.5415473) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:07:46.545211 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:07:46.545754 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:07:46.549326 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:07:46.549326 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:07:46.550407 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:07:46.550868 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:07:46.551277 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:07:46.551277 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:07:46.551429 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:07:46.551532 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:07:46.551758 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:07:46.551886 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:07:46.552038 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:07:46.552285 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:07:46.554287 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:07:46.554287 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:07:46.577322 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-394889113',display_name='tempest-AttachVolumeNegativeTest-server-394889113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-attachvolumenegativetest-server-394889113',id=20,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6IIHdwqchZi3JBtaZV0bfxLDKUktqdu0tyUYvzLcZukKR+hxgkz2mVOLmLJ+VjxSKc4R7YK6BANLQjjXyiK2tDXHCgoxChvDZFPTDNjgUBu5Ta/5xY5JAksl4eLB4VyA==',key_name='tempest-keypair-950689563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e01380196548bbbe8f5f9e9147494b',ramdisk_id='',reservation_id='r-62ht6kje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1145310491',owner_user_name='tempest-AttachVolumeNegativeTest-1145310491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:07:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4586ad9e4c304b0fa9a960267667ac64',uuid=0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a5f107a-eb9e-40bc-8054-427935e6421e", "address": "fa:16:3e:b0:f1:fd", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5f107a-eb", "ovs_interfaceid": "0a5f107a-eb9e-40bc-8054-427935e6421e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:07:46.577322 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converting VIF {"id": "0a5f107a-eb9e-40bc-8054-427935e6421e", "address": "fa:16:3e:b0:f1:fd", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5f107a-eb", "ovs_interfaceid": "0a5f107a-eb9e-40bc-8054-427935e6421e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:46.577322 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f1:fd,bridge_name='br-int',has_traffic_filtering=True,id=0a5f107a-eb9e-40bc-8054-427935e6421e,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5f107a-eb') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:46.579512 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:46.618884 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.624106 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.670580 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.740832 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.793630 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.806119 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-c1219592-35c0-47e5-a5e0-13dfd005aca9 req-6f0579fc-22da-49f0-9870-c798f5788622 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:46.839972 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.871880 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.936489 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:46.954861 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-94855374-74ed-4c68-8f81-fa6c260f2961 req-9b14b0d2-64f9-4212-a759-0e7b232da94f service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:46.955595 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-94855374-74ed-4c68-8f81-fa6c260f2961 req-9b14b0d2-64f9-4212-a759-0e7b232da94f service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:46.955854 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-94855374-74ed-4c68-8f81-fa6c260f2961 req-9b14b0d2-64f9-4212-a759-0e7b232da94f service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:46.956773 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-94855374-74ed-4c68-8f81-fa6c260f2961 req-9b14b0d2-64f9-4212-a759-0e7b232da94f service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:46.958468 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-94855374-74ed-4c68-8f81-fa6c260f2961 req-9b14b0d2-64f9-4212-a759-0e7b232da94f service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:46.958468 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-94855374-74ed-4c68-8f81-fa6c260f2961 req-9b14b0d2-64f9-4212-a759-0e7b232da94f service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-a320f909-4120-4240-816d-9a98fd363e9a for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:47.028967 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-10efe6ec-dec8-43e0-9154-3dfcca133924 req-23e2694a-e0cb-4bae-afe4-bb9aaf4fb1da service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:47.078141 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] End _get_guest_xml xml= Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: instance-00000014 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 196608 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: tempest-AttachVolumeNegativeTest-server-394889113 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 2026-06-03 01:07:46 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 192 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: True Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: bare Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: virtio Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: tempest-AttachVolumeNegativeTest-1145310491-project-member Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: tempest-AttachVolumeNegativeTest-1145310491 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: hvm Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 128 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Preparing to wait for external event network-vif-plugged-0a5f107a-eb9e-40bc-8054-427935e6421e {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:47.084274 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:47.087945 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-394889113',display_name='tempest-AttachVolumeNegativeTest-server-394889113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-attachvolumenegativetest-server-394889113',id=20,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6IIHdwqchZi3JBtaZV0bfxLDKUktqdu0tyUYvzLcZukKR+hxgkz2mVOLmLJ+VjxSKc4R7YK6BANLQjjXyiK2tDXHCgoxChvDZFPTDNjgUBu5Ta/5xY5JAksl4eLB4VyA==',key_name='tempest-keypair-950689563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e01380196548bbbe8f5f9e9147494b',ramdisk_id='',reservation_id='r-62ht6kje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1145310491',owner_user_name='tempest-AttachVolumeNegativeTest-1145310491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:07:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4586ad9e4c304b0fa9a960267667ac64',uuid=0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a5f107a-eb9e-40bc-8054-427935e6421e", "address": "fa:16:3e:b0:f1:fd", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5f107a-eb", "ovs_interfaceid": "0a5f107a-eb9e-40bc-8054-427935e6421e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:07:47.088941 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converting VIF {"id": "0a5f107a-eb9e-40bc-8054-427935e6421e", "address": "fa:16:3e:b0:f1:fd", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5f107a-eb", "ovs_interfaceid": "0a5f107a-eb9e-40bc-8054-427935e6421e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:47.089942 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f1:fd,bridge_name='br-int',has_traffic_filtering=True,id=0a5f107a-eb9e-40bc-8054-427935e6421e,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5f107a-eb') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:47.090291 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f1:fd,bridge_name='br-int',has_traffic_filtering=True,id=0a5f107a-eb9e-40bc-8054-427935e6421e,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5f107a-eb') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:07:47.090799 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.090965 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.091244 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:07:47.096103 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.096103 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e26de23-d9a0-5afe-bcb7-fbf101921ae3', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.098902 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.099381 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.114918 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.121255 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999679308000168 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:47.123587 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Instance destroyed successfully. Jun 03 01:07:47.124977 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lazy-loading 'resources' on Instance uuid 870f3e49-a1b4-4a7f-a936-66ed2280b505 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:47.170556 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.197835 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.197835 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a5f107a-eb, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.197835 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a5f107a-eb, col_values=(('qos', UUID('05f175b0-eb7a-4db3-9b0e-16528441d659')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.197835 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a5f107a-eb, col_values=(('external_ids', {'iface-id': '0a5f107a-eb9e-40bc-8054-427935e6421e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:f1:fd', 'vm-uuid': '0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.201627 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.204863 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.259894 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.261467 np0000002000 nova-compute[98288]: INFO os_vif [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f1:fd,bridge_name='br-int',has_traffic_filtering=True,id=0a5f107a-eb9e-40bc-8054-427935e6421e,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5f107a-eb') Jun 03 01:07:47.349415 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-27606ef0-8b65-4c62-a574-6c75c884a642 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "71626a81-876a-40b9-ae4f-a57455bf345b" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.624s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:47.401755 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-c1219592-35c0-47e5-a5e0-13dfd005aca9 req-6f0579fc-22da-49f0-9870-c798f5788622 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:47.592569 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00036705100001199753 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:47.592921 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:47.593048 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:47.593187 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] VM Stopped (Lifecycle Event) Jun 03 01:07:47.595010 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=8.980065819999936 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:47.595121 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=8.979939970999794 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:47.604645 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-10efe6ec-dec8-43e0-9154-3dfcca133924 req-23e2694a-e0cb-4bae-afe4-bb9aaf4fb1da service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:47.611917 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-c1219592-35c0-47e5-a5e0-13dfd005aca9 req-6f0579fc-22da-49f0-9870-c798f5788622 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Updated VIF entry in instance network info cache for port 0ff7144f-d5a9-47c6-9020-ee801a5b02d5. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:07:47.612228 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-c1219592-35c0-47e5-a5e0-13dfd005aca9 req-6f0579fc-22da-49f0-9870-c798f5788622 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Updating instance_info_cache with network_info: [{"id": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "address": "fa:16:3e:0b:6e:2b", "network": {"id": "246d6702-1aae-400a-8fff-b9cf129f6aeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145522194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff7144f-d5", "ovs_interfaceid": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:47.631953 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:02Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a320f909-4120-4240-816d-9a98fd363e9a", "address": "fa:16:3e:51:07:53", "network": {"id": "d10ab19a-aab5-4e75-a74f-de7b6c54ff1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1300013310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa320f909-41", "ovs_interfaceid": "a320f909-4120-4240-816d-9a98fd363e9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:07:47.632118 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "a320f909-4120-4240-816d-9a98fd363e9a", "address": "fa:16:3e:51:07:53", "network": {"id": "d10ab19a-aab5-4e75-a74f-de7b6c54ff1b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1300013310-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa320f909-41", "ovs_interfaceid": "a320f909-4120-4240-816d-9a98fd363e9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:47.632655 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:07:53,bridge_name='br-int',has_traffic_filtering=True,id=a320f909-4120-4240-816d-9a98fd363e9a,network=Network(d10ab19a-aab5-4e75-a74f-de7b6c54ff1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa320f909-41') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:47.632874 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:07:53,bridge_name='br-int',has_traffic_filtering=True,id=a320f909-4120-4240-816d-9a98fd363e9a,network=Network(d10ab19a-aab5-4e75-a74f-de7b6c54ff1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa320f909-41') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:07:47.634147 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.634350 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa320f909-41, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.638588 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.639285 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.691557 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.693176 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.693340 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=527e36ad-80bf-4650-9728-dd28ba755d1f) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.694123 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.694676 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.725119 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c6a944a6-457a-4b38-9d35-9f7683294c42 req-33dfdfb2-0813-4fa0-8732-da6c9cede27c service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-2b0eef10-c9f6-488a-9800-6e7d807e7336 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:47.727331 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c6a944a6-457a-4b38-9d35-9f7683294c42 req-33dfdfb2-0813-4fa0-8732-da6c9cede27c service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:47.727488 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c6a944a6-457a-4b38-9d35-9f7683294c42 req-33dfdfb2-0813-4fa0-8732-da6c9cede27c service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:47.727594 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c6a944a6-457a-4b38-9d35-9f7683294c42 req-33dfdfb2-0813-4fa0-8732-da6c9cede27c service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:47.727691 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c6a944a6-457a-4b38-9d35-9f7683294c42 req-33dfdfb2-0813-4fa0-8732-da6c9cede27c service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-2b0eef10-c9f6-488a-9800-6e7d807e7336 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:47.727796 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c6a944a6-457a-4b38-9d35-9f7683294c42 req-33dfdfb2-0813-4fa0-8732-da6c9cede27c service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-2b0eef10-c9f6-488a-9800-6e7d807e7336 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:47.727889 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c6a944a6-457a-4b38-9d35-9f7683294c42 req-33dfdfb2-0813-4fa0-8732-da6c9cede27c service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-2b0eef10-c9f6-488a-9800-6e7d807e7336 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:47.728000 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c6a944a6-457a-4b38-9d35-9f7683294c42 req-33dfdfb2-0813-4fa0-8732-da6c9cede27c service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:47.728127 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c6a944a6-457a-4b38-9d35-9f7683294c42 req-33dfdfb2-0813-4fa0-8732-da6c9cede27c service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:47.728209 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c6a944a6-457a-4b38-9d35-9f7683294c42 req-33dfdfb2-0813-4fa0-8732-da6c9cede27c service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:47.728310 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c6a944a6-457a-4b38-9d35-9f7683294c42 req-33dfdfb2-0813-4fa0-8732-da6c9cede27c service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-2b0eef10-c9f6-488a-9800-6e7d807e7336 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:47.728411 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-c6a944a6-457a-4b38-9d35-9f7683294c42 req-33dfdfb2-0813-4fa0-8732-da6c9cede27c service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-2b0eef10-c9f6-488a-9800-6e7d807e7336 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:47.738209 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.741607 np0000002000 nova-compute[98288]: INFO os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:07:53,bridge_name='br-int',has_traffic_filtering=True,id=a320f909-4120-4240-816d-9a98fd363e9a,network=Network(d10ab19a-aab5-4e75-a74f-de7b6c54ff1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa320f909-41') Jun 03 01:07:47.742384 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:02Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "address": "fa:16:3e:a8:11:d0", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7d0a64-f5", "ovs_interfaceid": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:07:47.742609 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "address": "fa:16:3e:a8:11:d0", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae7d0a64-f5", "ovs_interfaceid": "ae7d0a64-f5a4-4d43-84ce-d5f781f0b036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:47.743157 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:11:d0,bridge_name='br-int',has_traffic_filtering=True,id=ae7d0a64-f5a4-4d43-84ce-d5f781f0b036,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae7d0a64-f5') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:47.743397 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:11:d0,bridge_name='br-int',has_traffic_filtering=True,id=ae7d0a64-f5a4-4d43-84ce-d5f781f0b036,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae7d0a64-f5') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:07:47.746060 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.746060 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae7d0a64-f5, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.750366 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-10efe6ec-dec8-43e0-9154-3dfcca133924 req-23e2694a-e0cb-4bae-afe4-bb9aaf4fb1da service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Updated VIF entry in instance network info cache for port 0a5f107a-eb9e-40bc-8054-427935e6421e. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:07:47.750930 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-10efe6ec-dec8-43e0-9154-3dfcca133924 req-23e2694a-e0cb-4bae-afe4-bb9aaf4fb1da service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Updating instance_info_cache with network_info: [{"id": "0a5f107a-eb9e-40bc-8054-427935e6421e", "address": "fa:16:3e:b0:f1:fd", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5f107a-eb", "ovs_interfaceid": "0a5f107a-eb9e-40bc-8054-427935e6421e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:47.752844 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.775222 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.776343 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.776392 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1b93657-08bc-4bca-9849-8bd2105e68bc) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.777280 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.777555 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.806104 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.807886 np0000002000 nova-compute[98288]: INFO os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:11:d0,bridge_name='br-int',has_traffic_filtering=True,id=ae7d0a64-f5a4-4d43-84ce-d5f781f0b036,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapae7d0a64-f5') Jun 03 01:07:47.808452 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:02Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "address": "fa:16:3e:e3:c3:ae", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0eef10-c9", "ovs_interfaceid": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:07:47.808600 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "address": "fa:16:3e:e3:c3:ae", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b0eef10-c9", "ovs_interfaceid": "2b0eef10-c9f6-488a-9800-6e7d807e7336", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:47.809028 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c3:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b0eef10-c9f6-488a-9800-6e7d807e7336,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b0eef10-c9') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:47.809212 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c3:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b0eef10-c9f6-488a-9800-6e7d807e7336,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b0eef10-c9') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:07:47.809941 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.810102 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b0eef10-c9, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.811547 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.811938 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.835524 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.836203 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.836548 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37a287e3-76a5-4f90-a200-f13065f049f4) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.837114 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.837592 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.860056 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.861849 np0000002000 nova-compute[98288]: INFO os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:c3:ae,bridge_name='br-int',has_traffic_filtering=True,id=2b0eef10-c9f6-488a-9800-6e7d807e7336,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2b0eef10-c9') Jun 03 01:07:47.862530 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:02Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "address": "fa:16:3e:b7:f3:8b", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf898b240-5e", "ovs_interfaceid": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:07:47.862688 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "address": "fa:16:3e:b7:f3:8b", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf898b240-5e", "ovs_interfaceid": "f898b240-5ec0-4735-90c6-f8aa562b0cac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:47.863168 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f3:8b,bridge_name='br-int',has_traffic_filtering=True,id=f898b240-5ec0-4735-90c6-f8aa562b0cac,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf898b240-5e') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:47.863413 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f3:8b,bridge_name='br-int',has_traffic_filtering=True,id=f898b240-5ec0-4735-90c6-f8aa562b0cac,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf898b240-5e') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:07:47.864186 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.864349 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf898b240-5e, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.865794 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.866223 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.881454 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.883134 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.883349 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6592d256-bbfe-49b5-b4f1-43a3fe0c3ac5) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.884383 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.884949 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.900969 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.903035 np0000002000 nova-compute[98288]: INFO os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f3:8b,bridge_name='br-int',has_traffic_filtering=True,id=f898b240-5ec0-4735-90c6-f8aa562b0cac,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf898b240-5e') Jun 03 01:07:47.903861 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:02Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "address": "fa:16:3e:80:4c:19", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap185ebfc4-a0", "ovs_interfaceid": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:07:47.904081 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "address": "fa:16:3e:80:4c:19", "network": {"id": "a73abf1c-1bab-43b8-a2a3-390cc125c00e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1714412020", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap185ebfc4-a0", "ovs_interfaceid": "185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:47.904683 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:4c:19,bridge_name='br-int',has_traffic_filtering=True,id=185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185ebfc4-a0') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:47.904946 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:4c:19,bridge_name='br-int',has_traffic_filtering=True,id=185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185ebfc4-a0') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:07:47.905837 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.906011 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap185ebfc4-a0, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.908247 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.920835 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.924313 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.924564 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc91b601-3b0a-40ac-b474-74f4b85f7633) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.925678 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.940503 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.942201 np0000002000 nova-compute[98288]: INFO os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:4c:19,bridge_name='br-int',has_traffic_filtering=True,id=185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8,network=Network(a73abf1c-1bab-43b8-a2a3-390cc125c00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap185ebfc4-a0') Jun 03 01:07:47.942908 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:02Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "address": "fa:16:3e:23:58:90", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3239f51b-2b", "ovs_interfaceid": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:07:47.943087 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "address": "fa:16:3e:23:58:90", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3239f51b-2b", "ovs_interfaceid": "3239f51b-2bbd-4d49-a354-7e0a6a03549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:47.943645 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:58:90,bridge_name='br-int',has_traffic_filtering=True,id=3239f51b-2bbd-4d49-a354-7e0a6a03549a,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3239f51b-2b') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:47.943858 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:58:90,bridge_name='br-int',has_traffic_filtering=True,id=3239f51b-2bbd-4d49-a354-7e0a6a03549a,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3239f51b-2b') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:07:47.944559 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.944693 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3239f51b-2b, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.946285 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.946491 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.955659 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.956368 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.956528 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb352b69-0ab8-4df2-a64d-a11a9770a474) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.957299 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.958007 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.966455 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.969171 np0000002000 nova-compute[98288]: INFO os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:58:90,bridge_name='br-int',has_traffic_filtering=True,id=3239f51b-2bbd-4d49-a354-7e0a6a03549a,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3239f51b-2b') Jun 03 01:07:47.969854 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1979192484',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-1979192484',id=15,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlfMXHB9KtgE9clbWvt+x+5NWzbX3mne480u5dfaexyhJ2gbjNC2RbDRcysbf/N3WiGILS0Zhfjghgs8GPqp7laV1XmarAETgHaR0BRymgyMXFariyC/xkgDli3EbeMGw==',key_name='tempest-keypair-1712419653',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:02Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='7f0b405f69b049b390b824dd46c5fa95',ramdisk_id='',reservation_id='r-fet79mmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1757420274',owner_user_name='tempest-TaggedBootDevicesTest-1757420274-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34ccf4f2b4d0406e9688c5b64264c051',uuid=870f3e49-a1b4-4a7f-a936-66ed2280b505,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58487093-6f51-4a4b-968a-82b38b604734", "address": "fa:16:3e:60:04:19", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58487093-6f", "ovs_interfaceid": "58487093-6f51-4a4b-968a-82b38b604734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:07:47.970082 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converting VIF {"id": "58487093-6f51-4a4b-968a-82b38b604734", "address": "fa:16:3e:60:04:19", "network": {"id": "f3439364-6e5c-4ea4-b03c-511806812850", "bridge": "br-int", "label": "tempest-device-tagging-net2-265604312", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7f0b405f69b049b390b824dd46c5fa95", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58487093-6f", "ovs_interfaceid": "58487093-6f51-4a4b-968a-82b38b604734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:47.970538 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:04:19,bridge_name='br-int',has_traffic_filtering=True,id=58487093-6f51-4a4b-968a-82b38b604734,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58487093-6f') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:47.970715 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:04:19,bridge_name='br-int',has_traffic_filtering=True,id=58487093-6f51-4a4b-968a-82b38b604734,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58487093-6f') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:07:47.971416 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.971573 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58487093-6f, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.973662 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.978419 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:47.978600 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.979047 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "5fa25fea-9624-4611-8579-d6891f822679" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:47.979244 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:47.979410 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:47.979951 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:47.981214 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.981366 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=286d46d8-5887-4833-97b6-d7a0cdba640a) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:47.982219 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Terminating instance Jun 03 01:07:47.984534 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.985108 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:47.991432 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:47.992878 np0000002000 nova-compute[98288]: INFO os_vif [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:04:19,bridge_name='br-int',has_traffic_filtering=True,id=58487093-6f51-4a4b-968a-82b38b604734,network=Network(f3439364-6e5c-4ea4-b03c-511806812850),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58487093-6f') Jun 03 01:07:47.994011 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:07:47.994280 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:07:47.994433 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:47.994779 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:47.995023 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:07:47.995160 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:48.022263 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7 (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:07:48.022664 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '24')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:07:48.023779 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7', '23')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:07:48.024651 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Resulting device map defaultdict(. at 0x73e7bf61e340>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7'): ({'sdh'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:07:48.024839 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Removing multipathed devices sdh, sdi {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:07:48.025029 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Flush multipath device 330000000a8e9a161 {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:07:48.071638 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:07:48.095723 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c9d1332e-c10d-4a6d-a609-a2a3be6dc355 tempest-TestMultiAttachVolumeSwap-2138682875 tempest-TestMultiAttachVolumeSwap-2138682875-project-member] [instance: 02e31daf-9f87-4574-be4b-3ed12bd8f050] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:48.113945 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-c1219592-35c0-47e5-a5e0-13dfd005aca9 req-6f0579fc-22da-49f0-9870-c798f5788622 service nova] Releasing lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:48.125562 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:07:48.183121 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:07:48.183323 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:07:48.185135 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:07:48.198281 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:07:48.198572 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:07:48.213913 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.253935 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-10efe6ec-dec8-43e0-9154-3dfcca133924 req-23e2694a-e0cb-4bae-afe4-bb9aaf4fb1da service nova] Releasing lock "refresh_cache-0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:48.254737 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7, portal: 192.168.40.100,3260] Jun 03 01:07:48.254737 np0000002000 nova-compute[98288]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7, portal: 192.168.40.100,3260] successful. Jun 03 01:07:48.254737 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.275308 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.286258 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.327237 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7, portal: 192.168.50.100,3260] Jun 03 01:07:48.327237 np0000002000 nova-compute[98288]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-43ca1640-5e7c-4fa7-b67d-1b75597eeeb7, portal: 192.168.50.100,3260] successful. Jun 03 01:07:48.327237 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.346532 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.346736 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:48.346850 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] <== disconnect_volume: return (352ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:07:48.346955 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:07:48.347838 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:07:48.348054 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:07:48.348195 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:48.348421 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:48.348742 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:07:48.348871 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:07:48.375693 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:48.375811 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:48.377270 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:48.377270 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:48.377270 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:48.377270 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:48.377270 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:48.377270 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:48.377270 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:48.377270 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:48.377270 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:48.377270 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-ae7d0a64-f5a4-4d43-84ce-d5f781f0b036 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:48.377270 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-f898b240-5ec0-4735-90c6-f8aa562b0cac {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:48.377270 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:48.377778 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:48.377778 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:48.377778 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-f898b240-5ec0-4735-90c6-f8aa562b0cac {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:48.377778 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-f898b240-5ec0-4735-90c6-f8aa562b0cac for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:48.377778 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-f898b240-5ec0-4735-90c6-f8aa562b0cac {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:48.377995 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:48.377995 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:48.377995 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:48.378733 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-f898b240-5ec0-4735-90c6-f8aa562b0cac {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:48.378733 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-f898b240-5ec0-4735-90c6-f8aa562b0cac for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:48.378733 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:48.378733 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:48.378733 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:48.378733 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:48.378733 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:48.379209 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:48.379209 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:48.379209 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:48.379209 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:48.379209 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:48.379302 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:48.379462 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:48.379533 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-58487093-6f51-4a4b-968a-82b38b604734 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:48.379636 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:48.379734 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:48.379819 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:48.379927 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-58487093-6f51-4a4b-968a-82b38b604734 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:48.380032 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-58487093-6f51-4a4b-968a-82b38b604734 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:48.380121 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-58487093-6f51-4a4b-968a-82b38b604734 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:48.380603 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:48.380603 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:48.380603 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:48.380603 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-58487093-6f51-4a4b-968a-82b38b604734 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:48.380830 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8457d533-bb5d-4d97-ae31-9a82c072ccd0 req-a75e32fb-a679-4183-9567-d72fb72d81e1 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-58487093-6f51-4a4b-968a-82b38b604734 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:48.381341 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:48.381341 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:48.381341 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:48.381341 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:48.381341 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:48.381341 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:48.381341 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:48.381341 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:48.381341 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:48.381341 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:48.381341 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:48.381341 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:48.381341 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df (non-flash) Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:07:48.382593 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', '27')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:07:48.383091 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df', '28')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:07:48.383900 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Resulting device map defaultdict(. at 0x73e7b0196f20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df'): ({'sde'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:07:48.384081 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Removing multipathed devices sdd, sde {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:07:48.384282 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Flush multipath device 330000000fb9aebf6 {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:07:48.421080 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:07:48.466070 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:07:48.487545 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:07:48.514561 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:48.517983 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:48.521315 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:07:48.521315 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:07:48.522483 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:07:48.535386 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:07:48.535688 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:07:48.542893 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:48.547955 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.583775 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df, portal: 192.168.40.100,3260] Jun 03 01:07:48.583775 np0000002000 nova-compute[98288]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df, portal: 192.168.40.100,3260] successful. Jun 03 01:07:48.583775 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.611119 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.629055 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.670544 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df, portal: 192.168.50.100,3260] Jun 03 01:07:48.670544 np0000002000 nova-compute[98288]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-e2ae67a3-aa4d-424f-ba5e-c041a6f818df, portal: 192.168.50.100,3260] successful. Jun 03 01:07:48.670544 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.673468 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:48.681939 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:48.691128 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.691347 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:48.691476 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] <== disconnect_volume: return (342ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:07:48.691591 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:07:48.696815 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:07:48.697135 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f21eee2a-ec1f-4025-94ec-0b807c046f78', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:07:48.697281 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:48.697607 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:48.697886 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f21eee2a-ec1f-4025-94ec-0b807c046f78', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:07:48.698015 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:07:48.731103 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:48.731103 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:48.731103 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:48.731103 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:48.731103 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:48.731103 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:48.731103 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:48.731103 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:48.731103 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:48.731103 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:48.731103 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:48.731715 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:48.731715 np0000002000 nova-compute[98288]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78 (non-flash) Jun 03 01:07:48.731715 np0000002000 nova-compute[98288]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:48.731715 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:48.731715 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:48.731715 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:48.731715 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:48.731715 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:48.731715 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:48.731715 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:48.731715 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:48.731715 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:07:48.731715 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '25')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:07:48.732452 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78', '26')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:07:48.733251 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Resulting device map defaultdict(. at 0x73e7b0196f20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78'): ({'sdk'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:07:48.733428 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Removing multipathed devices sdk, sdj {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:07:48.734840 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Flush multipath device 3300000006e861b98 {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:07:48.779427 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:07:48.788600 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:48.788745 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:07:48.788835 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] No VIF found with MAC fa:16:3e:b0:f1:fd, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:07:48.789355 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Using config drive Jun 03 01:07:48.824786 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:07:48.839325 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.99970322099989 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:48.841251 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Instance destroyed successfully. Jun 03 01:07:48.845026 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'resources' on Instance uuid 5fa25fea-9624-4611-8579-d6891f822679 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:48.861972 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:07:48.861972 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:07:48.863418 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:07:48.877077 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:07:48.877223 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:07:48.889145 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.921616 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78, portal: 192.168.40.100,3260] Jun 03 01:07:48.921616 np0000002000 nova-compute[98288]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78, portal: 192.168.40.100,3260] successful. Jun 03 01:07:48.921616 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.941896 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.953276 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:48.997922 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78, portal: 192.168.50.100,3260] Jun 03 01:07:48.997922 np0000002000 nova-compute[98288]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-f21eee2a-ec1f-4025-94ec-0b807c046f78, portal: 192.168.50.100,3260] successful. Jun 03 01:07:48.997922 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:49.015787 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:49.016092 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:49.016261 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] <== disconnect_volume: return (318ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:07:49.016421 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:07:49.016790 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Deleting instance files /opt/stack/data/nova/instances/870f3e49-a1b4-4a7f-a936-66ed2280b505_del Jun 03 01:07:49.017335 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Deletion of /opt/stack/data/nova/instances/870f3e49-a1b4-4a7f-a936-66ed2280b505_del complete Jun 03 01:07:49.045582 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:49.045582 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:49.045711 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:49.045958 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:49.046243 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:49.046243 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-a320f909-4120-4240-816d-9a98fd363e9a for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:49.046351 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:49.046400 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:49.046584 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:49.046872 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:49.047004 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:49.047069 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-3239f51b-2bbd-4d49-a354-7e0a6a03549a for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:49.047162 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:49.047274 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Acquiring lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] No waiting events found dispatching network-vif-unplugged-3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-unplugged-3239f51b-2bbd-4d49-a354-7e0a6a03549a for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] No waiting events found dispatching network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Acquiring lock "5fa25fea-9624-4611-8579-d6891f822679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] Lock "5fa25fea-9624-4611-8579-d6891f822679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] No waiting events found dispatching network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:49.049468 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-e014a566-eca8-4ad6-8592-5de8753d3b02 req-e67938bf-94e7-4a4a-8afc-700d1a51e0cc service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-unplugged-c9849bf1-2517-4a9c-8033-605596ac9dfd for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:49.294839 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:49.349815 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-598665403',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-598665403',id=11,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-03T01:06:07Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-sdp2alb4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:06:13Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=5fa25fea-9624-4611-8579-d6891f822679,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:07:49.350086 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "address": "fa:16:3e:e5:47:da", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9849bf1-25", "ovs_interfaceid": "c9849bf1-2517-4a9c-8033-605596ac9dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:49.350755 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:47:da,bridge_name='br-int',has_traffic_filtering=True,id=c9849bf1-2517-4a9c-8033-605596ac9dfd,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9849bf1-25') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:49.351040 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:47:da,bridge_name='br-int',has_traffic_filtering=True,id=c9849bf1-2517-4a9c-8033-605596ac9dfd,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9849bf1-25') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:07:49.357054 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:49.357223 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9849bf1-25, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:49.359964 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:49.365309 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:49.366140 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:49.366294 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39a2448a-3115-4984-8e51-f6fab9de12b8) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:49.367060 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:49.367541 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:49.372748 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:49.377049 np0000002000 nova-compute[98288]: INFO os_vif [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:47:da,bridge_name='br-int',has_traffic_filtering=True,id=c9849bf1-2517-4a9c-8033-605596ac9dfd,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9849bf1-25') Jun 03 01:07:49.378412 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:07:49.378680 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:07:49.378800 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:07:49.379086 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:07:49.379343 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:07:49.379481 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:07:49.420726 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Creating config drive at /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk.config Jun 03 01:07:49.421247 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:49.421247 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:49.421247 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:49.421247 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:49.421247 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:49.421247 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:49.421247 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:49.421247 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:49.421247 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:07:49.421576 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:49.421576 np0000002000 nova-compute[98288]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:49.421576 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:07:49.421576 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:49.421576 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:07:49.421576 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:49.421576 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:07:49.421576 np0000002000 nova-compute[98288]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef (non-flash) Jun 03 01:07:49.421576 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:07:49.421734 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:07:49.421865 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '3')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:07:49.424003 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef', '4')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:07:49.425982 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Resulting device map defaultdict(. at 0x73e7942a5760>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef'): ({'sdc'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:07:49.426651 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Removing multipathed devices sdb, sdc {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:07:49.427021 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Flush multipath device 330000000681717e1 {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:07:49.427948 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpus91fd7e {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:49.462619 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:07:49.480926 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpus91fd7e" returned: 0 in 0.053s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:49.502870 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:07:49.535574 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Took 3.15 seconds to destroy the instance on the hypervisor. Jun 03 01:07:49.536515 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:07:49.536873 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:07:49.537020 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:07:49.537568 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:49.552645 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:07:49.552804 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:07:49.553998 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:07:49.565127 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:07:49.565405 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:07:49.576104 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:49.609824 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef, portal: 192.168.40.100,3260] Jun 03 01:07:49.609824 np0000002000 nova-compute[98288]: Logout of [sid: 3, target: iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef, portal: 192.168.40.100,3260] successful. Jun 03 01:07:49.609824 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:49.627811 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:49.640221 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:49.661460 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:49.675358 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef, portal: 192.168.50.100,3260] Jun 03 01:07:49.675358 np0000002000 nova-compute[98288]: Logout of [sid: 4, target: iqn.2023-03.storpool.com:os--volume-0f48e8a0-3cad-4972-9467-17b0c1c7bdef, portal: 192.168.50.100,3260] successful. Jun 03 01:07:49.675358 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:49.691857 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:07:49.692160 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:07:49.692298 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] <== disconnect_volume: return (313ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:07:49.692549 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:07:49.692841 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Deleting instance files /opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679_del Jun 03 01:07:49.693303 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Deletion of /opt/stack/data/nova/instances/5fa25fea-9624-4611-8579-d6891f822679_del complete Jun 03 01:07:49.912361 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:49.914422 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:49.939223 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:50.021830 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:50.064800 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:50.065725 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:50.205799 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Took 1.72 seconds to destroy the instance on the hypervisor. Jun 03 01:07:50.206261 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:07:50.206424 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:07:50.206536 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 5fa25fea-9624-4611-8579-d6891f822679] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:07:50.206730 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:50.284970 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:50.445159 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b308d8a2-0147-4141-b8e6-d7e19fbf3e22 req-e090dadf-1f09-4d58-a512-1bbccaf24f53 service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Received event network-vif-plugged-0a5f107a-eb9e-40bc-8054-427935e6421e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:50.445579 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b308d8a2-0147-4141-b8e6-d7e19fbf3e22 req-e090dadf-1f09-4d58-a512-1bbccaf24f53 service nova] Acquiring lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:50.446419 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b308d8a2-0147-4141-b8e6-d7e19fbf3e22 req-e090dadf-1f09-4d58-a512-1bbccaf24f53 service nova] Lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:50.446614 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b308d8a2-0147-4141-b8e6-d7e19fbf3e22 req-e090dadf-1f09-4d58-a512-1bbccaf24f53 service nova] Lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:50.447175 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b308d8a2-0147-4141-b8e6-d7e19fbf3e22 req-e090dadf-1f09-4d58-a512-1bbccaf24f53 service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Processing event network-vif-plugged-0a5f107a-eb9e-40bc-8054-427935e6421e {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:07:50.447373 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b308d8a2-0147-4141-b8e6-d7e19fbf3e22 req-e090dadf-1f09-4d58-a512-1bbccaf24f53 service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Received event network-vif-plugged-0a5f107a-eb9e-40bc-8054-427935e6421e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:50.447682 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b308d8a2-0147-4141-b8e6-d7e19fbf3e22 req-e090dadf-1f09-4d58-a512-1bbccaf24f53 service nova] Acquiring lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:50.448949 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b308d8a2-0147-4141-b8e6-d7e19fbf3e22 req-e090dadf-1f09-4d58-a512-1bbccaf24f53 service nova] Lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:50.449030 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b308d8a2-0147-4141-b8e6-d7e19fbf3e22 req-e090dadf-1f09-4d58-a512-1bbccaf24f53 service nova] Lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:50.449166 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b308d8a2-0147-4141-b8e6-d7e19fbf3e22 req-e090dadf-1f09-4d58-a512-1bbccaf24f53 service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] No waiting events found dispatching network-vif-plugged-0a5f107a-eb9e-40bc-8054-427935e6421e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:50.449297 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-b308d8a2-0147-4141-b8e6-d7e19fbf3e22 req-e090dadf-1f09-4d58-a512-1bbccaf24f53 service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Received unexpected event network-vif-plugged-0a5f107a-eb9e-40bc-8054-427935e6421e for instance with vm_state building and task_state spawning. Jun 03 01:07:50.492772 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Acquiring lock "731d6dce-0633-4f07-98af-b6da39e18417" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:50.492967 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "731d6dce-0633-4f07-98af-b6da39e18417" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:50.691741 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:50.693315 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:07:50.693514 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] VM Started (Lifecycle Event) Jun 03 01:07:50.696468 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:07:50.700144 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Instance spawned successfully. Jun 03 01:07:50.701092 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:07:50.994862 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:07:51.043037 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:51.198406 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:51.207698 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:51.210571 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:51.210693 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:51.210987 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:51.211192 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:51.211450 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:51.213614 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:07:51.265006 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bfa2f784-a891-4f41-9158-cd43a21a7fdd req-2bb5d975-4665-4c2d-9d68-e92256503659 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-deleted-58487093-6f51-4a4b-968a-82b38b604734 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:51.265140 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-bfa2f784-a891-4f41-9158-cd43a21a7fdd req-2bb5d975-4665-4c2d-9d68-e92256503659 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Neutron deleted interface 58487093-6f51-4a4b-968a-82b38b604734; detaching it from the instance and deleting it from the info cache Jun 03 01:07:51.267402 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bfa2f784-a891-4f41-9158-cd43a21a7fdd req-2bb5d975-4665-4c2d-9d68-e92256503659 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Detach interface failed, port_id=58487093-6f51-4a4b-968a-82b38b604734, reason: Instance 870f3e49-a1b4-4a7f-a936-66ed2280b505 could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:07:51.539511 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:51.539800 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:51.542841 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:07:51.543015 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Claim successful on node np0000002000 Jun 03 01:07:51.545910 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Took 1.34 seconds to deallocate network for instance. Jun 03 01:07:51.713505 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:07:51.713721 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:51.713820 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] VM Paused (Lifecycle Event) Jun 03 01:07:51.720909 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Took 6.25 seconds to spawn the instance on the hypervisor. Jun 03 01:07:51.720909 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:51.728770 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-57ce0e6f-dc9f-4330-8ed4-21a911c19a47 req-3c6ace25-1ad8-4380-ace3-af4bf6c31448 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-deleted-f898b240-5ec0-4735-90c6-f8aa562b0cac {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:51.729079 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-57ce0e6f-dc9f-4330-8ed4-21a911c19a47 req-3c6ace25-1ad8-4380-ace3-af4bf6c31448 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Neutron deleted interface f898b240-5ec0-4735-90c6-f8aa562b0cac; detaching it from the instance and deleting it from the info cache Jun 03 01:07:51.731387 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-57ce0e6f-dc9f-4330-8ed4-21a911c19a47 req-3c6ace25-1ad8-4380-ace3-af4bf6c31448 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Detach interface failed, port_id=f898b240-5ec0-4735-90c6-f8aa562b0cac, reason: Instance 870f3e49-a1b4-4a7f-a936-66ed2280b505 could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:07:52.090371 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Took 0.54 seconds to detach 1 volumes for instance. Jun 03 01:07:52.092765 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Deleting volume: 0f48e8a0-3cad-4972-9467-17b0c1c7bdef {{(pid=98288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}} Jun 03 01:07:52.216160 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:52.220010 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:52.220206 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] VM Resumed (Lifecycle Event) Jun 03 01:07:52.235119 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Took 12.18 seconds to build instance. Jun 03 01:07:52.366781 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:52.514335 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-449eb759-3559-4e98-b81c-f718d25a6595 req-598d1edf-92e8-424e-a987-fcfc0f1cbf20 service nova] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Received event network-vif-deleted-c9849bf1-2517-4a9c-8033-605596ac9dfd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:52.514483 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-449eb759-3559-4e98-b81c-f718d25a6595 req-598d1edf-92e8-424e-a987-fcfc0f1cbf20 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-deleted-a320f909-4120-4240-816d-9a98fd363e9a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:52.514936 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-449eb759-3559-4e98-b81c-f718d25a6595 req-598d1edf-92e8-424e-a987-fcfc0f1cbf20 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-deleted-3239f51b-2bbd-4d49-a354-7e0a6a03549a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:52.637574 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:52.724778 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:52.726281 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:07:52.736826 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-0abf26b7-0423-481a-b9e5-114fc9150756 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.705s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:52.868903 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Took 3.33 seconds to deallocate network for instance. Jun 03 01:07:52.941175 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:53.124527 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:07:53.124729 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:07:53.345832 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-7646566a-ee5f-458a-90b0-727baf35d495 req-15de5d8d-a4ce-40cc-a29c-e37a975e8e29 service nova] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Received event network-vif-deleted-185ebfc4-a0d7-4d9b-a3f8-c96191b6d8a8 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:53.627125 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:07:54.133221 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.593s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:54.134374 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.496s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:54.136621 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:07:54.369068 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:54.510374 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Took 1.64 seconds to detach 3 volumes for instance. Jun 03 01:07:54.599626 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-29fc997d-6dca-4eea-b04f-992bade64722 req-f1c466da-3d06-4d6e-927b-96c4459c3bff service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Received event network-changed-0a5f107a-eb9e-40bc-8054-427935e6421e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:54.602411 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-29fc997d-6dca-4eea-b04f-992bade64722 req-f1c466da-3d06-4d6e-927b-96c4459c3bff service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Refreshing instance network info cache due to event network-changed-0a5f107a-eb9e-40bc-8054-427935e6421e. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:07:54.602958 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-29fc997d-6dca-4eea-b04f-992bade64722 req-f1c466da-3d06-4d6e-927b-96c4459c3bff service nova] Acquiring lock "refresh_cache-0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:54.603111 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-29fc997d-6dca-4eea-b04f-992bade64722 req-f1c466da-3d06-4d6e-927b-96c4459c3bff service nova] Acquired lock "refresh_cache-0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:54.603316 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-29fc997d-6dca-4eea-b04f-992bade64722 req-f1c466da-3d06-4d6e-927b-96c4459c3bff service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Refreshing network info cache for port 0a5f107a-eb9e-40bc-8054-427935e6421e {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:07:54.642829 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:07:54.643147 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:07:54.643413 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:54.645457 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:54.717746 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:07:54.720487 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:07:54.728610 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '972243f63aba43f7aa29d45bec30d215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83eaa68ecf44639ab542987139d00a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:07:55.020210 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:55.105621 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-29fc997d-6dca-4eea-b04f-992bade64722 req-f1c466da-3d06-4d6e-927b-96c4459c3bff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:55.144364 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:07:55.165843 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Successfully created port: 5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:07:55.222170 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:07:55.414487 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-29fc997d-6dca-4eea-b04f-992bade64722 req-f1c466da-3d06-4d6e-927b-96c4459c3bff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:55.557529 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-29fc997d-6dca-4eea-b04f-992bade64722 req-f1c466da-3d06-4d6e-927b-96c4459c3bff service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Updated VIF entry in instance network info cache for port 0a5f107a-eb9e-40bc-8054-427935e6421e. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:07:55.557529 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-29fc997d-6dca-4eea-b04f-992bade64722 req-f1c466da-3d06-4d6e-927b-96c4459c3bff service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Updating instance_info_cache with network_info: [{"id": "0a5f107a-eb9e-40bc-8054-427935e6421e", "address": "fa:16:3e:b0:f1:fd", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5f107a-eb", "ovs_interfaceid": "0a5f107a-eb9e-40bc-8054-427935e6421e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:55.650631 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:07:55.663936 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Successfully updated port: 5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:07:55.715222 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-74dff6cc-d877-4d7c-8c86-94d3d8f291de req-ad18ab93-2fa9-437b-8483-27884403ed03 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Received event network-changed-5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:55.715358 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-74dff6cc-d877-4d7c-8c86-94d3d8f291de req-ad18ab93-2fa9-437b-8483-27884403ed03 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Refreshing instance network info cache due to event network-changed-5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:07:55.715513 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-74dff6cc-d877-4d7c-8c86-94d3d8f291de req-ad18ab93-2fa9-437b-8483-27884403ed03 service nova] Acquiring lock "refresh_cache-731d6dce-0633-4f07-98af-b6da39e18417" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:55.715617 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-74dff6cc-d877-4d7c-8c86-94d3d8f291de req-ad18ab93-2fa9-437b-8483-27884403ed03 service nova] Acquired lock "refresh_cache-731d6dce-0633-4f07-98af-b6da39e18417" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:55.715736 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-74dff6cc-d877-4d7c-8c86-94d3d8f291de req-ad18ab93-2fa9-437b-8483-27884403ed03 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Refreshing network info cache for port 5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:07:55.729163 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.596s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:55.730387 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.709s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:55.793872 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Deleted allocations for instance 5fa25fea-9624-4611-8579-d6891f822679 Jun 03 01:07:56.059917 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-29fc997d-6dca-4eea-b04f-992bade64722 req-f1c466da-3d06-4d6e-927b-96c4459c3bff service nova] Releasing lock "refresh_cache-0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:56.165513 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Acquiring lock "refresh_cache-731d6dce-0633-4f07-98af-b6da39e18417" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:07:56.220467 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-74dff6cc-d877-4d7c-8c86-94d3d8f291de req-ad18ab93-2fa9-437b-8483-27884403ed03 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:56.277094 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:07:56.277393 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:07:56.302023 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-74dff6cc-d877-4d7c-8c86-94d3d8f291de req-ad18ab93-2fa9-437b-8483-27884403ed03 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:07:56.423700 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-74dff6cc-d877-4d7c-8c86-94d3d8f291de req-ad18ab93-2fa9-437b-8483-27884403ed03 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:56.575457 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003474760001154209 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:56.575962 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:07:56.576105 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:56.576294 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] VM Stopped (Lifecycle Event) Jun 03 01:07:56.577273 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=5.5436395740000535 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:56.577366 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=5.543528633000051 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:56.658022 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:07:56.658796 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:07:56.658985 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Creating image(s) Jun 03 01:07:56.659347 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Acquiring lock "/opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:56.659473 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "/opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:56.662493 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "/opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:56.662493 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:56.662827 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:56.663617 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:56.735371 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.071s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:56.735738 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:56.736283 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:56.736789 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:56.739053 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:07:56.739485 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:56.781427 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:07:56.804425 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-8cc753e5-bad3-491d-9e35-ac8c390a8cd5 tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "5fa25fea-9624-4611-8579-d6891f822679" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.826s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:56.815559 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.076s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:56.816009 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:56.864043 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk 1073741824" returned: 0 in 0.048s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:56.864661 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.128s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:56.865106 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:56.926294 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-74dff6cc-d877-4d7c-8c86-94d3d8f291de req-ad18ab93-2fa9-437b-8483-27884403ed03 service nova] Releasing lock "refresh_cache-731d6dce-0633-4f07-98af-b6da39e18417" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:56.926921 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Acquired lock "refresh_cache-731d6dce-0633-4f07-98af-b6da39e18417" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:07:56.927133 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:07:56.945792 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.081s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:56.946201 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Checking if we can resize image /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:07:56.946417 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:07:57.019346 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:07:57.019753 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Cannot resize image /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:07:57.020103 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:07:57.020265 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Ensure instance console log exists: /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:07:57.020524 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:57.020784 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:57.020892 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:57.080673 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 71626a81-876a-40b9-ae4f-a57455bf345b] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:07:57.293676 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.564s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:57.356941 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Deleted allocations for instance 870f3e49-a1b4-4a7f-a936-66ed2280b505 Jun 03 01:07:57.507861 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:07:57.644146 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:57.738211 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:57.738371 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:57.738600 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:57.738742 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:57.738847 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:57.742273 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Terminating instance Jun 03 01:07:57.761695 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Updating instance_info_cache with network_info: [{"id": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "address": "fa:16:3e:fb:20:4b", "network": {"id": "8ae46afa-75df-4249-ab3d-8a386c58e044", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-315526179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f83eaa68ecf44639ab542987139d00a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb75bf1-c2", "ovs_interfaceid": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:07:57.967256 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.247055 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:07:58.263581 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Releasing lock "refresh_cache-731d6dce-0633-4f07-98af-b6da39e18417" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:07:58.265405 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Instance network_info: |[{"id": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "address": "fa:16:3e:fb:20:4b", "network": {"id": "8ae46afa-75df-4249-ab3d-8a386c58e044", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-315526179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f83eaa68ecf44639ab542987139d00a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb75bf1-c2", "ovs_interfaceid": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:07:58.265591 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Start _get_guest_xml network_info=[{"id": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "address": "fa:16:3e:fb:20:4b", "network": {"id": "8ae46afa-75df-4249-ab3d-8a386c58e044", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-315526179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f83eaa68ecf44639ab542987139d00a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb75bf1-c2", "ovs_interfaceid": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:07:58.269081 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.272031 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.287116 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:07:58.288606 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-10159362', uuid='731d6dce-0633-4f07-98af-b6da39e18417'), owner=OwnerMeta(userid='972243f63aba43f7aa29d45bec30d215', username='tempest-VolumesSnapshotTestJSON-1626537970-project-member', projectid='f83eaa68ecf44639ab542987139d00a4', projectname='tempest-VolumesSnapshotTestJSON-1626537970'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "address": "fa:16:3e:fb:20:4b", "network": {"id": "8ae46afa-75df-4249-ab3d-8a386c58e044", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-315526179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f83eaa68ecf44639ab542987139d00a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb75bf1-c2", "ovs_interfaceid": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448878.2880702) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:07:58.291209 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.295828 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:07:58.296698 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:07:58.296698 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.298825 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:07:58.298825 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:07:58.299866 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:07:58.300196 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:07:58.300356 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:07:58.300471 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:07:58.300639 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:07:58.300717 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:07:58.300819 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:07:58.301011 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:07:58.301111 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:07:58.301224 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:07:58.301326 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:07:58.301634 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:07:58.314462 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.318261 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-10159362',display_name='tempest-VolumesSnapshotTestJSON-instance-10159362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-volumessnapshottestjson-instance-10159362',id=21,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOom2OtS6mP0CaANtbL66TkPqilQWvgaUIPvhiz29b1MCZP4hM1G2DfIIePT0s3Bjgkd51YoUWYXVGokVpt8fVAHkzYZQ8wKRQs+K7n8x6x0kgf/oI+g9wmoKpo4Va3RRw==',key_name='tempest-keypair-79707946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f83eaa68ecf44639ab542987139d00a4',ramdisk_id='',reservation_id='r-4zi0vtjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1626537970',owner_user_name='tempest-VolumesSnapshotTestJSON-1626537970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='972243f63aba43f7aa29d45bec30d215',uuid=731d6dce-0633-4f07-98af-b6da39e18417,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "address": "fa:16:3e:fb:20:4b", "network": {"id": "8ae46afa-75df-4249-ab3d-8a386c58e044", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-315526179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f83eaa68ecf44639ab542987139d00a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb75bf1-c2", "ovs_interfaceid": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:07:58.318807 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Converting VIF {"id": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "address": "fa:16:3e:fb:20:4b", "network": {"id": "8ae46afa-75df-4249-ab3d-8a386c58e044", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-315526179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f83eaa68ecf44639ab542987139d00a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb75bf1-c2", "ovs_interfaceid": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:58.319612 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:20:4b,bridge_name='br-int',has_traffic_filtering=True,id=5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a,network=Network(8ae46afa-75df-4249-ab3d-8a386c58e044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb75bf1-c2') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:58.319838 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lazy-loading 'pci_devices' on Instance uuid 731d6dce-0633-4f07-98af-b6da39e18417 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:58.320812 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.365330 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-d90e98ef-65a0-4c7e-9e13-deb8b50c87a4 tempest-TaggedBootDevicesTest-1757420274 tempest-TaggedBootDevicesTest-1757420274-project-member] Lock "870f3e49-a1b4-4a7f-a936-66ed2280b505" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 12.493s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:58.482163 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-09d27e8e-a7f0-409d-8ba3-d63750784e56 req-e934077c-514f-47c8-b10e-46a2e1b04001 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Received event network-vif-unplugged-1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:07:58.483530 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-09d27e8e-a7f0-409d-8ba3-d63750784e56 req-e934077c-514f-47c8-b10e-46a2e1b04001 service nova] Acquiring lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:58.483898 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-09d27e8e-a7f0-409d-8ba3-d63750784e56 req-e934077c-514f-47c8-b10e-46a2e1b04001 service nova] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:58.484080 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-09d27e8e-a7f0-409d-8ba3-d63750784e56 req-e934077c-514f-47c8-b10e-46a2e1b04001 service nova] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:58.484270 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-09d27e8e-a7f0-409d-8ba3-d63750784e56 req-e934077c-514f-47c8-b10e-46a2e1b04001 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] No waiting events found dispatching network-vif-unplugged-1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:07:58.484704 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-09d27e8e-a7f0-409d-8ba3-d63750784e56 req-e934077c-514f-47c8-b10e-46a2e1b04001 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Received event network-vif-unplugged-1d295ed9-260a-4fd7-a169-b87add358744 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:07:58.564613 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.571094 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.590486 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.99973024000019 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:07:58.592464 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Instance destroyed successfully. Jun 03 01:07:58.592932 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lazy-loading 'resources' on Instance uuid 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] End _get_guest_xml xml= Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 731d6dce-0633-4f07-98af-b6da39e18417 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: instance-00000015 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 196608 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: tempest-VolumesSnapshotTestJSON-instance-10159362 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 2026-06-03 01:07:58 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 192 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: True Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: bare Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 0 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: virtio Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: tempest-VolumesSnapshotTestJSON-1626537970-project-member Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: tempest-VolumesSnapshotTestJSON-1626537970 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 731d6dce-0633-4f07-98af-b6da39e18417 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 731d6dce-0633-4f07-98af-b6da39e18417 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: hvm Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 128 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: 1 Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: Jun 03 01:07:58.822976 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:07:58.824683 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Preparing to wait for external event network-vif-plugged-5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:07:58.824683 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Acquiring lock "731d6dce-0633-4f07-98af-b6da39e18417-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:58.824683 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "731d6dce-0633-4f07-98af-b6da39e18417-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:58.824683 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "731d6dce-0633-4f07-98af-b6da39e18417-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:58.824683 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-10159362',display_name='tempest-VolumesSnapshotTestJSON-instance-10159362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-volumessnapshottestjson-instance-10159362',id=21,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOom2OtS6mP0CaANtbL66TkPqilQWvgaUIPvhiz29b1MCZP4hM1G2DfIIePT0s3Bjgkd51YoUWYXVGokVpt8fVAHkzYZQ8wKRQs+K7n8x6x0kgf/oI+g9wmoKpo4Va3RRw==',key_name='tempest-keypair-79707946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f83eaa68ecf44639ab542987139d00a4',ramdisk_id='',reservation_id='r-4zi0vtjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1626537970',owner_user_name='tempest-VolumesSnapshotTestJSON-1626537970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='972243f63aba43f7aa29d45bec30d215',uuid=731d6dce-0633-4f07-98af-b6da39e18417,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "address": "fa:16:3e:fb:20:4b", "network": {"id": "8ae46afa-75df-4249-ab3d-8a386c58e044", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-315526179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f83eaa68ecf44639ab542987139d00a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb75bf1-c2", "ovs_interfaceid": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:07:58.824683 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Converting VIF {"id": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "address": "fa:16:3e:fb:20:4b", "network": {"id": "8ae46afa-75df-4249-ab3d-8a386c58e044", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-315526179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f83eaa68ecf44639ab542987139d00a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb75bf1-c2", "ovs_interfaceid": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:58.824953 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:20:4b,bridge_name='br-int',has_traffic_filtering=True,id=5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a,network=Network(8ae46afa-75df-4249-ab3d-8a386c58e044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb75bf1-c2') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:58.826899 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:20:4b,bridge_name='br-int',has_traffic_filtering=True,id=5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a,network=Network(8ae46afa-75df-4249-ab3d-8a386c58e044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb75bf1-c2') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:07:58.826899 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.826899 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:58.827434 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:07:58.829365 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.829365 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02f37d27-e299-52a7-9ec3-969bded6cd1b', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:58.830350 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:58.834866 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.836734 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.838136 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cb75bf1-c2, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:58.838136 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cb75bf1-c2, col_values=(('qos', UUID('09e85037-c559-4c3d-aa27-16499b35e142')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:58.838136 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cb75bf1-c2, col_values=(('external_ids', {'iface-id': '5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:20:4b', 'vm-uuid': '731d6dce-0633-4f07-98af-b6da39e18417'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:58.839736 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:58.849632 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:58.850216 np0000002000 nova-compute[98288]: INFO os_vif [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:20:4b,bridge_name='br-int',has_traffic_filtering=True,id=5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a,network=Network(8ae46afa-75df-4249-ab3d-8a386c58e044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb75bf1-c2') Jun 03 01:07:59.095153 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:04:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-205644783',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverbootfromvolumestablerescuetest-server-205644783',id=2,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-03T01:05:10Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='e3b5c165c8b142b6af1c20eeac918eb0',ramdisk_id='',reservation_id='r-tga00ogs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:05:20Z,user_data=None,user_id='6a5f52b75bd44cd880fcd26870d24190',uuid=4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d295ed9-260a-4fd7-a169-b87add358744", "address": "fa:16:3e:b8:08:22", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d295ed9-26", "ovs_interfaceid": "1d295ed9-260a-4fd7-a169-b87add358744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:07:59.095304 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converting VIF {"id": "1d295ed9-260a-4fd7-a169-b87add358744", "address": "fa:16:3e:b8:08:22", "network": {"id": "5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2067982458-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e3b5c165c8b142b6af1c20eeac918eb0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d295ed9-26", "ovs_interfaceid": "1d295ed9-260a-4fd7-a169-b87add358744", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:07:59.095822 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:08:22,bridge_name='br-int',has_traffic_filtering=True,id=1d295ed9-260a-4fd7-a169-b87add358744,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d295ed9-26') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:07:59.096064 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:08:22,bridge_name='br-int',has_traffic_filtering=True,id=1d295ed9-260a-4fd7-a169-b87add358744,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d295ed9-26') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:07:59.098103 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:59.098103 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d295ed9-26, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:59.101194 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:59.105044 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:59.107059 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:59.108629 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed3e23ad-f362-4a7c-abff-21fc8d6fa829) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:07:59.109157 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:07:59.113525 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:59.116727 np0000002000 nova-compute[98288]: INFO os_vif [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:08:22,bridge_name='br-int',has_traffic_filtering=True,id=1d295ed9-260a-4fd7-a169-b87add358744,network=Network(5ac8f650-d9fa-454c-b06f-f8ee4e18b9bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d295ed9-26') Jun 03 01:07:59.117673 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Deleting instance files /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff_del Jun 03 01:07:59.117753 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Deletion of /opt/stack/data/nova/instances/4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff_del complete Jun 03 01:07:59.245899 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:59.246117 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:59.246204 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:07:59.246304 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:07:59.246375 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:07:59.250042 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Terminating instance Jun 03 01:07:59.485856 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:59.622810 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Took 1.38 seconds to destroy the instance on the hypervisor. Jun 03 01:07:59.623474 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:07:59.623855 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:07:59.623962 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:07:59.624196 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:59.741636 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:07:59.754472 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:07:59.786075 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:59.791595 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:59.816702 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:59.818972 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:07:59.851731 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:00.067289 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-745a3ff9-a217-4271-9bce-dbf58865b5f5 req-721ca138-3380-4cd5-835d-0fd8dad82030 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Received event network-vif-deleted-1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:00.067738 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-745a3ff9-a217-4271-9bce-dbf58865b5f5 req-721ca138-3380-4cd5-835d-0fd8dad82030 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Neutron deleted interface 1d295ed9-260a-4fd7-a169-b87add358744; detaching it from the instance and deleting it from the info cache Jun 03 01:08:00.073076 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-745a3ff9-a217-4271-9bce-dbf58865b5f5 req-721ca138-3380-4cd5-835d-0fd8dad82030 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Detach interface failed, port_id=1d295ed9-260a-4fd7-a169-b87add358744, reason: Instance 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:08:00.114586 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999742321999975 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:00.119461 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Instance destroyed successfully. Jun 03 01:08:00.119842 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lazy-loading 'resources' on Instance uuid fd0a3a08-1a8c-482c-836a-19ac700c473f {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:00.369496 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:00.369496 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:00.369496 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] No VIF found with MAC fa:16:3e:fb:20:4b, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:08:00.369496 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Using config drive Jun 03 01:08:00.508322 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:00.536454 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Received event network-vif-unplugged-1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:00.539767 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] Acquiring lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:00.540225 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:00.540348 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:00.540616 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] No waiting events found dispatching network-vif-unplugged-1d295ed9-260a-4fd7-a169-b87add358744 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:00.540756 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Received event network-vif-unplugged-1d295ed9-260a-4fd7-a169-b87add358744 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:08:00.540885 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event network-vif-unplugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:00.541011 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:00.541139 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:00.541242 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:00.541352 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] No waiting events found dispatching network-vif-unplugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:00.541479 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event network-vif-unplugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:08:00.541602 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event network-vif-unplugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:00.542019 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] Acquiring lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:00.542647 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:00.542773 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:00.542914 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] No waiting events found dispatching network-vif-unplugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:00.543021 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-260dfbb5-fe44-40bf-b954-bcdf9239dcf9 req-733aa22a-6b7a-4e01-85f8-638a412469b3 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event network-vif-unplugged-c4966a48-9680-4d94-b3d2-f1ffb52ae18f for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:08:00.622540 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-03T01:05:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1297217656',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serveractionsv293testjson-server-1203236219',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOg/hEenxdNX4Z4QcNELt5stRwXZTqpWqT/PnVuKXCyR5nUlt1GylsaLK+alFPxegCcwDcE1qtmOZmRjXIw2iSsxnqNGSTWidkIuhnCdIaEbbKV6LWajW9bpcLx4K00nA==',key_name='tempest-keypair-2103291389',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:21Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ae2da6faf29d4db18ccfc9a42a93ab7d',ramdisk_id='',reservation_id='r-1quzjl2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='d525a532-1643-48cd-87e8-a667d774c5cf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-378692121',owner_user_name='tempest-ServerActionsV293TestJSON-378692121-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5200a7ff60b4b65812c39efec311990',uuid=fd0a3a08-1a8c-482c-836a-19ac700c473f,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:08:00.622737 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Converting VIF {"id": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "address": "fa:16:3e:52:40:dc", "network": {"id": "9fb2bcc7-4f84-4f65-a4d9-88884f96af79", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1943759714-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ae2da6faf29d4db18ccfc9a42a93ab7d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4966a48-96", "ovs_interfaceid": "c4966a48-9680-4d94-b3d2-f1ffb52ae18f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:00.623138 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:00.623352 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:08:00.624217 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:00.624452 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4966a48-96, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:00.625963 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:00.626346 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:00.632333 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:00.632941 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:00.633099 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b47a9006-4cf3-40c1-a6a5-0cb3328f0960) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:00.633830 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:00.634158 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:00.638663 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:00.640635 np0000002000 nova-compute[98288]: INFO os_vif [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:dc,bridge_name='br-int',has_traffic_filtering=True,id=c4966a48-9680-4d94-b3d2-f1ffb52ae18f,network=Network(9fb2bcc7-4f84-4f65-a4d9-88884f96af79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4966a48-96') Jun 03 01:08:00.641651 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:08:00.641964 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:00.642087 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:00.642491 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:00.642803 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:08:00.642954 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:08:00.666947 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:08:00.666947 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:08:00.666947 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:08:00.666947 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:08:00.666947 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:00.666947 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:00.666947 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:00.667189 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:08:00.667189 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:08:00.667189 np0000002000 nova-compute[98288]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:08:00.667189 np0000002000 nova-compute[98288]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688 (non-flash) Jun 03 01:08:00.667189 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:00.667189 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:00.667189 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:00.667298 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '39')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:08:00.667353 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '35')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:08:00.668655 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688', '36')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:08:00.669357 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Resulting device map defaultdict(. at 0x73e7b82a98a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'): ({'sdo'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:08:00.669597 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Removing multipathed devices sdo, sdn {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:08:00.669826 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Flush multipath device 330000000ddb5455d {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:08:00.723343 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:08:00.772828 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:08:00.817677 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:08:00.817864 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:08:00.818794 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:08:00.833250 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:08:00.833470 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:08:00.844677 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:00.873032 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:00.881956 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.40.100,3260] Jun 03 01:08:00.881956 np0000002000 nova-compute[98288]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.40.100,3260] successful. Jun 03 01:08:00.881956 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:00.898469 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:00.911150 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:00.936062 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.50.100,3260] Jun 03 01:08:00.936062 np0000002000 nova-compute[98288]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-9f4e6e13-762a-4df4-82c3-0f4e04b9b688, portal: 192.168.50.100,3260] successful. Jun 03 01:08:00.936062 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:00.951715 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:00.951928 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:00.952047 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] <== disconnect_volume: return (310ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:00.952168 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:08:00.955514 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Deleting instance files /opt/stack/data/nova/instances/fd0a3a08-1a8c-482c-836a-19ac700c473f_del Jun 03 01:08:00.955514 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Deletion of /opt/stack/data/nova/instances/fd0a3a08-1a8c-482c-836a-19ac700c473f_del complete Jun 03 01:08:01.010129 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Took 1.39 seconds to deallocate network for instance. Jun 03 01:08:01.035328 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Creating config drive at /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk.config Jun 03 01:08:01.038274 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvhisgvao {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:01.095653 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvhisgvao" returned: 0 in 0.057s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:01.461565 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Took 1.71 seconds to destroy the instance on the hypervisor. Jun 03 01:08:01.462261 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:08:01.462261 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:08:01.462261 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:08:01.465652 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:01.506388 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:01.519400 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:01.519778 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:01.541380 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:01.548895 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:01.559155 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:01.633076 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:01.863206 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:01.865823 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:01.870490 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:01.894723 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:02.122676 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0012840790000154811 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:02.122676 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:02.122676 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=1.7165318849999949 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:02.122676 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=1.7163245389999702 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:02.125087 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:02.125087 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] VM Stopped (Lifecycle Event) Jun 03 01:08:02.134334 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b5c3d8d3-647e-4b06-a634-cea12b265a42 req-ab0d7176-7200-4a0a-a876-d942b38df288 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Received event network-vif-plugged-5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:02.134334 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b5c3d8d3-647e-4b06-a634-cea12b265a42 req-ab0d7176-7200-4a0a-a876-d942b38df288 service nova] Acquiring lock "731d6dce-0633-4f07-98af-b6da39e18417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:02.134334 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b5c3d8d3-647e-4b06-a634-cea12b265a42 req-ab0d7176-7200-4a0a-a876-d942b38df288 service nova] Lock "731d6dce-0633-4f07-98af-b6da39e18417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:02.134600 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b5c3d8d3-647e-4b06-a634-cea12b265a42 req-ab0d7176-7200-4a0a-a876-d942b38df288 service nova] Lock "731d6dce-0633-4f07-98af-b6da39e18417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:02.134600 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b5c3d8d3-647e-4b06-a634-cea12b265a42 req-ab0d7176-7200-4a0a-a876-d942b38df288 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Processing event network-vif-plugged-5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:08:02.134679 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b5c3d8d3-647e-4b06-a634-cea12b265a42 req-ab0d7176-7200-4a0a-a876-d942b38df288 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Received event network-vif-plugged-5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:02.135178 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b5c3d8d3-647e-4b06-a634-cea12b265a42 req-ab0d7176-7200-4a0a-a876-d942b38df288 service nova] Acquiring lock "731d6dce-0633-4f07-98af-b6da39e18417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:02.135349 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b5c3d8d3-647e-4b06-a634-cea12b265a42 req-ab0d7176-7200-4a0a-a876-d942b38df288 service nova] Lock "731d6dce-0633-4f07-98af-b6da39e18417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:02.135489 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b5c3d8d3-647e-4b06-a634-cea12b265a42 req-ab0d7176-7200-4a0a-a876-d942b38df288 service nova] Lock "731d6dce-0633-4f07-98af-b6da39e18417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:02.135716 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b5c3d8d3-647e-4b06-a634-cea12b265a42 req-ab0d7176-7200-4a0a-a876-d942b38df288 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] No waiting events found dispatching network-vif-plugged-5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:02.135842 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-b5c3d8d3-647e-4b06-a634-cea12b265a42 req-ab0d7176-7200-4a0a-a876-d942b38df288 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Received unexpected event network-vif-plugged-5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a for instance with vm_state building and task_state spawning. Jun 03 01:08:02.141956 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:08:02.142224 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:08:02.327573 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:02.327712 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] VM Started (Lifecycle Event) Jun 03 01:08:02.328915 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:08:02.334492 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:08:02.334586 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Instance spawned successfully. Jun 03 01:08:02.334901 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:08:02.336871 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:02.337040 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:02.532493 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:02.602000 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-9a68a070-3164-4b5c-9240-0747a950a7d6 req-7f7defb9-2b4e-48f2-8762-851deb05ab59 service nova] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Received event network-vif-deleted-c4966a48-9680-4d94-b3d2-f1ffb52ae18f {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:02.627579 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 870f3e49-a1b4-4a7f-a936-66ed2280b505] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:02.644719 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:08:02.830928 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:02.832032 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:08:02.841603 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Detaching volume 31598b30-9bba-48ca-8710-053a06d2b0c0 Jun 03 01:08:02.846558 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:02.846558 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:02.847042 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:02.847568 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:02.847923 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:02.848293 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:02.884331 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Attempting to driver detach volume 31598b30-9bba-48ca-8710-053a06d2b0c0 from mountpoint /dev/vdb Jun 03 01:08:02.887298 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Found disk vdb by alias ua-31598b30-9bba-48ca-8710-053a06d2b0c0 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:08:02.888858 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Found disk vdb by alias ua-31598b30-9bba-48ca-8710-053a06d2b0c0 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:08:02.888858 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Attempting to detach device vdb from instance 0584c6a8-64fc-4891-ba12-b8ede4275b95 from the persistent domain config. {{(pid=98288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 03 01:08:02.888858 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] detach device xml: Jun 03 01:08:02.888858 np0000002000 nova-compute[98288]: Jun 03 01:08:02.888858 np0000002000 nova-compute[98288]: Jun 03 01:08:02.888858 np0000002000 nova-compute[98288]: Jun 03 01:08:02.888858 np0000002000 nova-compute[98288]: Jun 03 01:08:02.888858 np0000002000 nova-compute[98288]: 31598b30-9bba-48ca-8710-053a06d2b0c0 Jun 03 01:08:02.888858 np0000002000 nova-compute[98288]:
Jun 03 01:08:02.888858 np0000002000 nova-compute[98288]: Jun 03 01:08:02.888858 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:08:02.895267 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Successfully detached device vdb from instance 0584c6a8-64fc-4891-ba12-b8ede4275b95 from the persistent domain config. Jun 03 01:08:02.895267 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] (1/8): Attempting to detach device vdb with device alias ua-31598b30-9bba-48ca-8710-053a06d2b0c0 from instance 0584c6a8-64fc-4891-ba12-b8ede4275b95 from the live domain config. {{(pid=98288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 03 01:08:02.895267 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] detach device xml: Jun 03 01:08:02.895267 np0000002000 nova-compute[98288]: Jun 03 01:08:02.895267 np0000002000 nova-compute[98288]: Jun 03 01:08:02.895267 np0000002000 nova-compute[98288]: Jun 03 01:08:02.895267 np0000002000 nova-compute[98288]: Jun 03 01:08:02.895267 np0000002000 nova-compute[98288]: 31598b30-9bba-48ca-8710-053a06d2b0c0 Jun 03 01:08:02.895267 np0000002000 nova-compute[98288]:
Jun 03 01:08:02.895267 np0000002000 nova-compute[98288]: Jun 03 01:08:02.895267 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:08:02.981475 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:03.034034 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Took 1.57 seconds to deallocate network for instance. Jun 03 01:08:03.152570 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.633s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:03.201382 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Deleted allocations for instance 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff Jun 03 01:08:03.335694 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:08:03.335694 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:03.335694 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] VM Paused (Lifecycle Event) Jun 03 01:08:03.353994 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Took 6.70 seconds to spawn the instance on the hypervisor. Jun 03 01:08:03.354214 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:03.373838 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-31598b30-9bba-48ca-8710-053a06d2b0c0 for instance 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 03 01:08:03.580775 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Took 0.55 seconds to detach 1 volumes for instance. Jun 03 01:08:03.587978 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Deleting volume: 9f4e6e13-762a-4df4-82c3-0f4e04b9b688 {{(pid=98288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}} Jun 03 01:08:03.837365 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:03.839029 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:03.839677 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006816980001076445 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:03.839961 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] VM Resumed (Lifecycle Event) Jun 03 01:08:03.840990 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:03.841291 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:03.842379 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] VM Stopped (Lifecycle Event) Jun 03 01:08:03.842379 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=9.748145045000001 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:03.842379 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=9.748022772000013 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:03.861971 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Took 12.36 seconds to build instance. Jun 03 01:08:04.141145 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:04.141145 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:04.214073 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45df8f43-366d-431a-9eb9-5809064e339d tempest-ServerBootFromVolumeStableRescueTest-1020364370 tempest-ServerBootFromVolumeStableRescueTest-1020364370-project-member] Lock "4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.476s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:04.343979 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:04.344825 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 5fa25fea-9624-4611-8579-d6891f822679] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:04.347817 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:08:04.364666 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "731d6dce-0633-4f07-98af-b6da39e18417" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 13.871s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:04.601095 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:08:04.601496 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:08:04.796159 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-f6124bba-7832-44a0-a7ef-44504ddb33ab req-da79a7b9-2b5b-487f-aea7-e1806426d147 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Received event network-changed-5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:04.796159 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-f6124bba-7832-44a0-a7ef-44504ddb33ab req-da79a7b9-2b5b-487f-aea7-e1806426d147 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Refreshing instance network info cache due to event network-changed-5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:04.796159 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-f6124bba-7832-44a0-a7ef-44504ddb33ab req-da79a7b9-2b5b-487f-aea7-e1806426d147 service nova] Acquiring lock "refresh_cache-731d6dce-0633-4f07-98af-b6da39e18417" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:04.796159 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-f6124bba-7832-44a0-a7ef-44504ddb33ab req-da79a7b9-2b5b-487f-aea7-e1806426d147 service nova] Acquired lock "refresh_cache-731d6dce-0633-4f07-98af-b6da39e18417" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:04.796159 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-f6124bba-7832-44a0-a7ef-44504ddb33ab req-da79a7b9-2b5b-487f-aea7-e1806426d147 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Refreshing network info cache for port 5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:04.851092 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Received event ua-31598b30-9bba-48ca-8710-053a06d2b0c0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98288) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 03 01:08:04.853269 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Successfully detached device vdb from instance 0584c6a8-64fc-4891-ba12-b8ede4275b95 from the live domain config. Jun 03 01:08:04.854158 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:08:04.854505 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31598b30-9bba-48ca-8710-053a06d2b0c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:04.854644 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:04.854993 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:04.855298 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31598b30-9bba-48ca-8710-053a06d2b0c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:08:04.855450 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsi session list stdout=tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0 (non-flash) Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '39')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '32')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0', '31')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Resulting device map defaultdict(. at 0x73e7b80beca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0'): ({'sdm'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:08:04.889806 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Removing multipathed devices sdm, sdl {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:08:04.890292 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Flush multipath device 3300000000d1cd1da {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:08:04.924326 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:08:04.961013 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:04.972832 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:08:05.014740 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:08:05.014920 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:08:05.015644 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:08:05.026375 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:08:05.026576 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:08:05.036328 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:05.069550 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0, portal: 192.168.40.100,3260] Jun 03 01:08:05.069550 np0000002000 nova-compute[98288]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0, portal: 192.168.40.100,3260] successful. Jun 03 01:08:05.069550 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:05.081454 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:05.090335 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:05.103496 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:08:05.120769 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0, portal: 192.168.50.100,3260] Jun 03 01:08:05.120769 np0000002000 nova-compute[98288]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-31598b30-9bba-48ca-8710-053a06d2b0c0, portal: 192.168.50.100,3260] successful. Jun 03 01:08:05.120769 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:05.135624 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:05.136188 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:05.137132 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] <== disconnect_volume: return (282ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:05.137132 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:08:05.298205 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-f6124bba-7832-44a0-a7ef-44504ddb33ab req-da79a7b9-2b5b-487f-aea7-e1806426d147 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:05.610361 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.469s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:05.620042 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-f6124bba-7832-44a0-a7ef-44504ddb33ab req-da79a7b9-2b5b-487f-aea7-e1806426d147 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:05.633521 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:05.689453 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Deleted allocations for instance fd0a3a08-1a8c-482c-836a-19ac700c473f Jun 03 01:08:05.691466 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'flavor' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:05.788213 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-f6124bba-7832-44a0-a7ef-44504ddb33ab req-da79a7b9-2b5b-487f-aea7-e1806426d147 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Updated VIF entry in instance network info cache for port 5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:08:05.788487 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-f6124bba-7832-44a0-a7ef-44504ddb33ab req-da79a7b9-2b5b-487f-aea7-e1806426d147 service nova] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Updating instance_info_cache with network_info: [{"id": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "address": "fa:16:3e:fb:20:4b", "network": {"id": "8ae46afa-75df-4249-ab3d-8a386c58e044", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-315526179-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f83eaa68ecf44639ab542987139d00a4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb75bf1-c2", "ovs_interfaceid": "5cb75bf1-c28f-47d3-b17d-dc2a16e32e5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:06.106484 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:06.290376 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-f6124bba-7832-44a0-a7ef-44504ddb33ab req-da79a7b9-2b5b-487f-aea7-e1806426d147 service nova] Releasing lock "refresh_cache-731d6dce-0633-4f07-98af-b6da39e18417" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:06.695694 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-5a992668-75e1-4744-b2db-8dc84410269b tempest-ServerActionsV293TestJSON-378692121 tempest-ServerActionsV293TestJSON-378692121-project-member] Lock "fd0a3a08-1a8c-482c-836a-19ac700c473f" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.450s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:06.697215 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-385de981-a0ff-4615-870a-0643825b61db tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.360s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:06.893323 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:07.726022 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:07.726539 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:07.726539 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:07.726539 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:07.726757 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:07.728428 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Terminating instance Jun 03 01:08:07.983714 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:08.236474 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:08:08.254699 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:08.258354 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:08.281113 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:08.429356 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:08.434695 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:08.459235 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2285e135-03df-4c6f-9424-82e3e7cbb5bb req-b646a36d-4da9-438c-9d34-7dc27bc682ad service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:08.459421 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2285e135-03df-4c6f-9424-82e3e7cbb5bb req-b646a36d-4da9-438c-9d34-7dc27bc682ad service nova] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:08.460193 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2285e135-03df-4c6f-9424-82e3e7cbb5bb req-b646a36d-4da9-438c-9d34-7dc27bc682ad service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:08.460314 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2285e135-03df-4c6f-9424-82e3e7cbb5bb req-b646a36d-4da9-438c-9d34-7dc27bc682ad service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:08.460453 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2285e135-03df-4c6f-9424-82e3e7cbb5bb req-b646a36d-4da9-438c-9d34-7dc27bc682ad service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] No waiting events found dispatching network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:08.460612 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2285e135-03df-4c6f-9424-82e3e7cbb5bb req-b646a36d-4da9-438c-9d34-7dc27bc682ad service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:08:08.540886 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:08.547901 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:08.573698 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.99965448099988 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:08.577801 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Instance destroyed successfully. Jun 03 01:08:08.579636 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'resources' on Instance uuid 0584c6a8-64fc-4891-ba12-b8ede4275b95 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:08.637676 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:08:08.637937 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:08:08.638192 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:08:08.638600 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:08:08.638976 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:08:08.639281 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:08:08.639503 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:08:08.639982 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:08:08.640164 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 03 01:08:08.640356 np0000002000 nova-compute[98288]: DEBUG oslo_service.periodic_task [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98288) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 03 01:08:09.083749 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:05:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-481754813',display_name='tempest-ServerRescueNegativeTestJSON-server-481754813',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverrescuenegativetestjson-server-481754813',id=13,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL1bTBKcpZPABlrsAC0BEunnlWZIWUncp1/s0rBJZiMFQjI/YvZ2jDYP4Ergq3etXYSswYhNLR8uVFWr/Jo8efkJFJWEw+g8AUr5Em0kds/F9DhSJhBU+c6WxuFLkZllw==',key_name='tempest-keypair-1134454194',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:16Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8d71b7749b9b414ea4fb3ad943aebf49',ramdisk_id='',reservation_id='r-dhd481f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-335039479',owner_user_name='tempest-ServerRescueNegativeTestJSON-335039479-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a97328826b194121a85a35b41129c1a9',uuid=0584c6a8-64fc-4891-ba12-b8ede4275b95,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:08:09.084378 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converting VIF {"id": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "address": "fa:16:3e:5e:4e:78", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32c927ec-83", "ovs_interfaceid": "32c927ec-8321-4de0-9cd5-36aaf8f01e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:09.084747 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:4e:78,bridge_name='br-int',has_traffic_filtering=True,id=32c927ec-8321-4de0-9cd5-36aaf8f01e7e,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c927ec-83') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:09.084864 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:4e:78,bridge_name='br-int',has_traffic_filtering=True,id=32c927ec-8321-4de0-9cd5-36aaf8f01e7e,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c927ec-83') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:08:09.086182 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:09.086499 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32c927ec-83, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:09.089363 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:09.090357 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:09.090541 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6688abf-410a-4755-925a-8b9d7db84a81) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:09.092293 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:09.093964 np0000002000 nova-compute[98288]: INFO os_vif [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:4e:78,bridge_name='br-int',has_traffic_filtering=True,id=32c927ec-8321-4de0-9cd5-36aaf8f01e7e,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32c927ec-83') Jun 03 01:08:09.094407 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Deleting instance files /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95_del Jun 03 01:08:09.095188 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Deletion of /opt/stack/data/nova/instances/0584c6a8-64fc-4891-ba12-b8ede4275b95_del complete Jun 03 01:08:09.144680 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:09.144837 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:09.144963 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:09.145101 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Auditing locally available compute resources for np0000002000 (node: np0000002000) {{(pid=98288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 03 01:08:09.603540 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Took 1.37 seconds to destroy the instance on the hypervisor. Jun 03 01:08:09.603540 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:08:09.603540 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:08:09.603540 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:08:09.603540 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:09.650995 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:09.717566 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:10.173977 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fb763a01-dc96-4957-9671-b90bd47716c6 req-68731d64-6c79-4cda-9fdd-7586479f1093 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-deleted-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:10.174383 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-fb763a01-dc96-4957-9671-b90bd47716c6 req-68731d64-6c79-4cda-9fdd-7586479f1093 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Neutron deleted interface 32c927ec-8321-4de0-9cd5-36aaf8f01e7e; detaching it from the instance and deleting it from the info cache Jun 03 01:08:10.182108 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fb763a01-dc96-4957-9671-b90bd47716c6 req-68731d64-6c79-4cda-9fdd-7586479f1093 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Detach interface failed, port_id=32c927ec-8321-4de0-9cd5-36aaf8f01e7e, reason: Instance 0584c6a8-64fc-4891-ba12-b8ede4275b95 could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:08:10.183734 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:10.268897 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:10.269009 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:10.356959 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:10.357793 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] skipping disk /dev/dm-13 (vdb) as it is a volume {{(pid=98288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}} Jun 03 01:08:10.363247 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:10.409436 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:10.454032 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:10.455016 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:10.535862 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-86c88aa7-5a7c-482a-8e3b-5af05f6e1e3f req-76a0713f-00c1-4c73-bce8-feb8c9e1e408 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:10.536283 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-86c88aa7-5a7c-482a-8e3b-5af05f6e1e3f req-76a0713f-00c1-4c73-bce8-feb8c9e1e408 service nova] Acquiring lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:10.536587 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-86c88aa7-5a7c-482a-8e3b-5af05f6e1e3f req-76a0713f-00c1-4c73-bce8-feb8c9e1e408 service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:10.536805 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-86c88aa7-5a7c-482a-8e3b-5af05f6e1e3f req-76a0713f-00c1-4c73-bce8-feb8c9e1e408 service nova] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:10.536997 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-86c88aa7-5a7c-482a-8e3b-5af05f6e1e3f req-76a0713f-00c1-4c73-bce8-feb8c9e1e408 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] No waiting events found dispatching network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:10.537203 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-86c88aa7-5a7c-482a-8e3b-5af05f6e1e3f req-76a0713f-00c1-4c73-bce8-feb8c9e1e408 service nova] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Received event network-vif-unplugged-32c927ec-8321-4de0-9cd5-36aaf8f01e7e for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:08:10.542343 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:10.546068 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:10.619592 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:10.643797 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:10.644280 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:10.723759 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731d6dce-0633-4f07-98af-b6da39e18417/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:10.729225 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:10.814914 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:10.818461 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:10.901621 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:10.904791 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Error from libvirt while getting description of instance-0000000d: [Error Code 42] Domain not found: no domain with matching uuid '0584c6a8-64fc-4891-ba12-b8ede4275b95' (instance-0000000d): libvirt.libvirtError: Domain not found: no domain with matching uuid '0584c6a8-64fc-4891-ba12-b8ede4275b95' (instance-0000000d) Jun 03 01:08:10.908456 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:10.925241 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] instance snapshotting Jun 03 01:08:10.992259 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:10.992827 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:11.052975 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Beginning live snapshot process Jun 03 01:08:11.087524 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6eefbe1c-468b-4294-9f24-7cc661bb3df2/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:11.087642 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:11.125857 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Took 1.52 seconds to deallocate network for instance. Jun 03 01:08:11.183703 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue --force-share --output=json" returned: 0 in 0.096s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:11.184236 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:11.270771 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk.rescue --force-share --output=json" returned: 0 in 0.084s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:11.270771 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:11.363737 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:11.365897 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:11.367217 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:11.451112 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:11.456610 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:11.540320 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:11.541881 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:11.634344 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:11.636552 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:11.653247 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:11.656409 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:08:11.657355 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:11.698825 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] CMD "env LANG=C uptime" returned: 0 in 0.041s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:11.699186 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Hypervisor/Node resource view: name=np0000002000 free_ram=12311MB free_disk=74.34489440917969GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 03 01:08:11.699368 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:12.157606 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:08:12.157838 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:08:12.581128 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk --force-share --output=json -f qcow2 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:12.661808 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:08:12.673179 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk --force-share --output=json -f qcow2" returned: 0 in 0.092s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:12.676347 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk --force-share --output=json -f qcow2 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:12.784258 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk --force-share --output=json -f qcow2" returned: 0 in 0.110s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:12.785021 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:12.788908 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:12.789229 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:12.887715 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.098s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:12.888256 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8u0a2lwa/af25d7982dcf420aa238bdd243a1cee6.delta 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:12.940401 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8u0a2lwa/af25d7982dcf420aa238bdd243a1cee6.delta 1073741824" returned: 0 in 0.052s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:12.941244 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Quiescing instance not available: QEMU guest agent is not enabled. Jun 03 01:08:12.985523 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:13.130201 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:13.192595 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.558s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:13.195505 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.493s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:13.218643 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] COPY block job progress, current cursor: 196608 final cursor: 76677120 {{(pid=98288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 03 01:08:13.251584 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Deleted allocations for instance 0584c6a8-64fc-4891-ba12-b8ede4275b95 Jun 03 01:08:13.590695 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005364589999317104 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:13.592294 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:13.592491 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] VM Stopped (Lifecycle Event) Jun 03 01:08:13.593464 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:13.593632 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=1.5200674069999422 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:13.593678 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=1.5199762810000266 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:13.720633 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] COPY block job progress, current cursor: 76677120 final cursor: 76677120 {{(pid=98288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 03 01:08:13.722401 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 03 01:08:13.771458 np0000002000 nova-compute[98288]: DEBUG nova.privsep.utils [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 03 01:08:13.771879 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8u0a2lwa/af25d7982dcf420aa238bdd243a1cee6.delta /opt/stack/data/nova/instances/snapshots/tmp8u0a2lwa/af25d7982dcf420aa238bdd243a1cee6 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:14.032178 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8u0a2lwa/af25d7982dcf420aa238bdd243a1cee6.delta /opt/stack/data/nova/instances/snapshots/tmp8u0a2lwa/af25d7982dcf420aa238bdd243a1cee6" returned: 0 in 0.260s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:14.037158 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Snapshot extracted, beginning image upload Jun 03 01:08:14.092212 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:14.098371 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-207612c2-4abd-4709-b251-cd245d31f72f tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 4eaef7e8-b8a0-4f8c-aa44-b40c2181e4ff] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:14.233567 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:14.262379 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-45ce3f91-81dd-42bd-a1d2-17e542b48fc7 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "0584c6a8-64fc-4891-ba12-b8ede4275b95" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.536s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:14.267539 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance cbb3ba9a-f26f-40c4-ac5b-00470740fd96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:08:14.267894 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 2bdcee06-76d6-431e-bef1-84b1acf1ccca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:08:14.269363 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:08:14.269363 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:08:14.269363 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 6eefbe1c-468b-4294-9f24-7cc661bb3df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:08:14.269363 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:08:14.269363 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Instance 731d6dce-0633-4f07-98af-b6da39e18417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 03 01:08:14.269363 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 03 01:08:14.269363 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Final resource view: name=np0000002000 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 01:08:11 up 31 min, 2 users, load average: 8.79, 5.90, 2.87\n', 'num_instances': '7', 'num_vm_active': '6', 'num_task_None': '6', 'num_os_type_None': '7', 'num_proj_8d71b7749b9b414ea4fb3ad943aebf49': '2', 'io_workload': '0', 'num_vm_rescued': '1', 'num_proj_88e01380196548bbbe8f5f9e9147494b': '2', 'num_task_image_pending_upload': '1', 'num_proj_a2a3f095839e4616a6f1efd27c8d5e7e': '1', 'num_proj_f52af3a46de7498c8225030529c1d868': '1', 'num_proj_f83eaa68ecf44639ab542987139d00a4': '1'} {{(pid=98288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 03 01:08:14.401683 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:14.673749 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:08:14.674143 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:08:15.115486 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0017766140001640451 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:15.116040 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:15.116207 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] VM Stopped (Lifecycle Event) Jun 03 01:08:15.117350 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:15.117562 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=8.455763329999854 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:15.117997 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=8.455565060000026 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:15.178517 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:08:15.620141 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: fd0a3a08-1a8c-482c-836a-19ac700c473f] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:15.686081 np0000002000 nova-compute[98288]: DEBUG nova.compute.resource_tracker [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Compute_service record updated for np0000002000:np0000002000 {{(pid=98288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 03 01:08:15.686562 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.493s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:15.687132 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [None req-693164d2-3da5-4a8e-8bb9-5dde3ff28543 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:08:16.019925 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:16.113959 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:16.976288 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Snapshot image upload complete Jun 03 01:08:16.976826 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-b246b74f-a5ce-4c0b-87bb-50f56bae89cd tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Took 6.05 seconds to snapshot the instance on the hypervisor. Jun 03 01:08:17.997768 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:18.228567 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:18.228567 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:18.228567 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:18.228567 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:18.228567 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:18.232469 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Terminating instance Jun 03 01:08:18.443788 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:18.444240 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:18.614336 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:18.736159 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:08:18.757504 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:18.785329 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:18.929300 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:18.935061 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:18.948170 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lazy-loading 'flavor' on Instance uuid 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:19.044102 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:19.079238 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999732644000005 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:19.081981 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Instance destroyed successfully. Jun 03 01:08:19.082497 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'resources' on Instance uuid 2bdcee06-76d6-431e-bef1-84b1acf1ccca {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:19.094869 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:19.587525 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-933697352',display_name='tempest-ServerRescueNegativeTestJSON-server-933697352',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverrescuenegativetestjson-server-933697352',id=10,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-03T01:05:32Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8d71b7749b9b414ea4fb3ad943aebf49',ramdisk_id='',reservation_id='r-4yumn2hi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-335039479',owner_user_name='tempest-ServerRescueNegativeTestJSON-335039479-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:05:32Z,user_data=None,user_id='a97328826b194121a85a35b41129c1a9',uuid=2bdcee06-76d6-431e-bef1-84b1acf1ccca,vcpu_model=,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:08:19.587787 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converting VIF {"id": "d485fb06-fb35-4f18-a724-b98151540d40", "address": "fa:16:3e:72:87:e7", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd485fb06-fb", "ovs_interfaceid": "d485fb06-fb35-4f18-a724-b98151540d40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:19.588395 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:87:e7,bridge_name='br-int',has_traffic_filtering=True,id=d485fb06-fb35-4f18-a724-b98151540d40,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd485fb06-fb') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:19.588648 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:87:e7,bridge_name='br-int',has_traffic_filtering=True,id=d485fb06-fb35-4f18-a724-b98151540d40,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd485fb06-fb') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:08:19.590842 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:19.591116 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd485fb06-fb, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:19.594432 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:19.596700 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:19.596913 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a09b5d9-4ef2-486b-ad5e-4226179fed00) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:19.598057 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:19.601078 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:19.607816 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "d4e14707-ef0a-46a8-aa4b-12951363c2e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:19.608664 np0000002000 nova-compute[98288]: INFO os_vif [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:87:e7,bridge_name='br-int',has_traffic_filtering=True,id=d485fb06-fb35-4f18-a724-b98151540d40,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd485fb06-fb') Jun 03 01:08:19.608897 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "d4e14707-ef0a-46a8-aa4b-12951363c2e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:19.610224 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Deleting instance files /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca_del Jun 03 01:08:19.611453 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Deletion of /opt/stack/data/nova/instances/2bdcee06-76d6-431e-bef1-84b1acf1ccca_del complete Jun 03 01:08:19.955920 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.512s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:20.111004 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:08:20.123696 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Took 1.38 seconds to destroy the instance on the hypervisor. Jun 03 01:08:20.123696 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:08:20.123696 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:08:20.123696 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:08:20.123696 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:20.201392 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:20.225633 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:20.225897 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:20.226140 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:20.226325 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:20.226497 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:20.229110 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Terminating instance Jun 03 01:08:20.493857 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-0a058d8a-2638-4269-be29-4c249e74c358 req-cdf5c871-f1b3-447e-9f74-ed08bbbec87d service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Received event network-vif-deleted-d485fb06-fb35-4f18-a724-b98151540d40 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:20.494032 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-0a058d8a-2638-4269-be29-4c249e74c358 req-cdf5c871-f1b3-447e-9f74-ed08bbbec87d service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Neutron deleted interface d485fb06-fb35-4f18-a724-b98151540d40; detaching it from the instance and deleting it from the info cache Jun 03 01:08:20.495220 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-0a058d8a-2638-4269-be29-4c249e74c358 req-cdf5c871-f1b3-447e-9f74-ed08bbbec87d service nova] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Detach interface failed, port_id=d485fb06-fb35-4f18-a724-b98151540d40, reason: Instance 2bdcee06-76d6-431e-bef1-84b1acf1ccca could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:08:20.658038 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:20.658246 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:20.661145 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:08:20.661287 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Claim successful on node np0000002000 Jun 03 01:08:20.733037 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:08:20.752953 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:20.756178 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:20.777123 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:20.901487 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:20.906784 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:20.930474 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:21.025042 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:21.025185 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:21.025360 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Attaching volume 8692f17c-5ea5-47f1-8c58-4ae3c5185693 to /dev/vdb Jun 03 01:08:21.037008 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:21.044355 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:21.066117 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999694253999905 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:21.067173 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Instance destroyed successfully. Jun 03 01:08:21.067594 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lazy-loading 'resources' on Instance uuid 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:21.077329 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:21.089707 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:08:21.110465 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:21.142178 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:08:21.143891 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:08:21.151510 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:08:21.154190 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe29:1d7b', 'fe80::fc16:3eff:fe25:b72e', 'fe80::3c0a:faff:fe92:9db2', 'fe80::fc16:3eff:fe2e:c45e', 'fe80::b499:daff:fe68:cfe4', 'fe80::fc16:3eff:fe0b:6e2b', 'fe80::58fc:8ff:fe98:1e95', 'fe80::fc16:3eff:fefb:204b', 'fe80::58e8:72ff:fe3d:6def'] Jun 03 01:08:21.154322 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:08:21.154435 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:08:21.154720 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] <== get_connector_properties: return (76ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:21.154971 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Updating existing volume attachment record: 8779d6b3-ad26-436d-abc8-34575710b200 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:08:21.438526 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Took 1.32 seconds to deallocate network for instance. Jun 03 01:08:21.570078 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-394889113',display_name='tempest-AttachVolumeNegativeTest-server-394889113',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-attachvolumenegativetest-server-394889113',id=20,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6IIHdwqchZi3JBtaZV0bfxLDKUktqdu0tyUYvzLcZukKR+hxgkz2mVOLmLJ+VjxSKc4R7YK6BANLQjjXyiK2tDXHCgoxChvDZFPTDNjgUBu5Ta/5xY5JAksl4eLB4VyA==',key_name='tempest-keypair-950689563',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:51Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='88e01380196548bbbe8f5f9e9147494b',ramdisk_id='',reservation_id='r-62ht6kje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1145310491',owner_user_name='tempest-AttachVolumeNegativeTest-1145310491-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4586ad9e4c304b0fa9a960267667ac64',uuid=0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a5f107a-eb9e-40bc-8054-427935e6421e", "address": "fa:16:3e:b0:f1:fd", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5f107a-eb", "ovs_interfaceid": "0a5f107a-eb9e-40bc-8054-427935e6421e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:08:21.570350 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converting VIF {"id": "0a5f107a-eb9e-40bc-8054-427935e6421e", "address": "fa:16:3e:b0:f1:fd", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a5f107a-eb", "ovs_interfaceid": "0a5f107a-eb9e-40bc-8054-427935e6421e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:21.571032 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f1:fd,bridge_name='br-int',has_traffic_filtering=True,id=0a5f107a-eb9e-40bc-8054-427935e6421e,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5f107a-eb') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:21.571282 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f1:fd,bridge_name='br-int',has_traffic_filtering=True,id=0a5f107a-eb9e-40bc-8054-427935e6421e,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5f107a-eb') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:08:21.572746 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:21.573131 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a5f107a-eb, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:21.575311 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:21.576252 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:21.577209 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:21.577369 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05f175b0-eb7a-4db3-9b0e-16528441d659) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:21.577880 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:21.578408 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:21.580085 np0000002000 nova-compute[98288]: INFO os_vif [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:f1:fd,bridge_name='br-int',has_traffic_filtering=True,id=0a5f107a-eb9e-40bc-8054-427935e6421e,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a5f107a-eb') Jun 03 01:08:21.580399 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Deleting instance files /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7_del Jun 03 01:08:21.581084 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Deletion of /opt/stack/data/nova/instances/0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7_del complete Jun 03 01:08:21.703280 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:08:21.703638 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:21.703768 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:21.704109 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:21.704314 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:08:21.714810 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:21.715422 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:21.715422 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:08:21.716805 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:21.717398 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:21.717847 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:08:21.726094 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:08:21.726094 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:21.731021 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:08:21.731021 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:21.736468 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693] added Jun 03 01:08:21.736468 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:08:21.736468 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:21.736468 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:21.736468 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:21.736468 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:21.736468 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:21.736712 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:08:21.736794 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0213(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:08:21.737046 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:08:21.741419 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693] added Jun 03 01:08:21.741419 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:08:21.741419 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:21.741419 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:21.741419 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:21.741419 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:21.741419 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:21.741832 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:08:21.741832 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0241(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:08:21.741832 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:08:21.944969 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:22.011466 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:08:22.011701 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:08:22.085784 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Took 1.35 seconds to destroy the instance on the hypervisor. Jun 03 01:08:22.086941 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:08:22.087301 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:08:22.087426 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:08:22.087769 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:22.167667 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:22.514859 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:08:22.582076 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-1bca5149-1639-4193-bdc6-985b4b424223 req-d82547cb-9e3b-4eaf-8424-d201b105b774 service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Received event network-vif-deleted-0a5f107a-eb9e-40bc-8054-427935e6421e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:22.582228 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-1bca5149-1639-4193-bdc6-985b4b424223 req-d82547cb-9e3b-4eaf-8424-d201b105b774 service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Neutron deleted interface 0a5f107a-eb9e-40bc-8054-427935e6421e; detaching it from the instance and deleting it from the info cache Jun 03 01:08:22.583492 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-1bca5149-1639-4193-bdc6-985b4b424223 req-d82547cb-9e3b-4eaf-8424-d201b105b774 service nova] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Detach interface failed, port_id=0a5f107a-eb9e-40bc-8054-427935e6421e, reason: Instance 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7 could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:08:22.737369 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:08:22.742134 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:08:22.748897 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:08:22.753754 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:22.760034 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:22.767224 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:22.773291 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.773291 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.773291 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:22.773482 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsi session list stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.773482 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.773482 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:22.779963 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.779963 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.779963 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:22.780112 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsi session list stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.780112 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.780112 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:22.808592 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693, portal: 192.168.40.100,3260] Jun 03 01:08:22.808592 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693, portal: 192.168.40.100,3260] successful. Jun 03 01:08:22.808592 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:22.817678 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:22.823023 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693, portal: 192.168.50.100,3260] Jun 03 01:08:22.823023 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693, portal: 192.168.50.100,3260] successful. Jun 03 01:08:22.823023 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:22.829676 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.829676 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.829676 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:22.829676 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:22.829676 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:22.829886 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsi session list stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.829886 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.829886 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:22.829886 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:22.829886 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:22.830067 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.115s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:22.830132 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:08:22.830688 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] HCTL ('7', '-', '-', 0) found on session 40 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:08:22.830784 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:08:22.831763 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:22.843302 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Searching for a device in session 40 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:08:22.843302 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:08:22.846393 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.846393 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.846393 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:22.846393 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:22.846393 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:22.846543 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsi session list stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.846543 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:22.846543 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:22.846543 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:22.846543 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:22.846763 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.129s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:22.846863 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:08:22.847348 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] HCTL ('8', '-', '-', 0) found on session 41 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:08:22.847459 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:08:22.864223 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Searching for a device in session 41 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:08:22.864223 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:08:22.999220 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:23.021393 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.363s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:23.021941 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.077s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:23.022156 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:08:23.040761 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:23.285278 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "interface-6eefbe1c-468b-4294-9f24-7cc661bb3df2-None" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:23.287706 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "interface-6eefbe1c-468b-4294-9f24-7cc661bb3df2-None" acquired by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: waited 0.003s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:23.288021 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lazy-loading 'flavor' on Instance uuid 6eefbe1c-468b-4294-9f24-7cc661bb3df2 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:23.367781 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:08:23.368001 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:08:23.528031 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:08:23.528261 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:08:23.528697 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:23.528935 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:23.542607 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Took 1.46 seconds to deallocate network for instance. Jun 03 01:08:23.574223 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0008503690000907227 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:23.574409 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:23.574587 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=10.504312659000107 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:23.574712 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=10.504175549000138 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:23.575190 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:23.575375 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] VM Stopped (Lifecycle Event) Jun 03 01:08:23.598018 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78fb92b522cd485b9d2ea55fa096b4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac66984846344d438d4d4208f858a38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:08:23.717885 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:08:23.790998 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:23.870805 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:08:23.952291 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lazy-loading 'pci_requests' on Instance uuid 6eefbe1c-468b-4294-9f24-7cc661bb3df2 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:23.956047 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Successfully created port: 2b07ef45-8a47-47fc-80b4-16b6c45aafa7 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:08:24.029208 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:08:24.048390 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:24.078086 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 0584c6a8-64fc-4891-ba12-b8ede4275b95] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:24.377406 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.356s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:24.378962 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.329s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:24.400763 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Successfully updated port: 2b07ef45-8a47-47fc-80b4-16b6c45aafa7 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:08:24.442250 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Deleted allocations for instance 2bdcee06-76d6-431e-bef1-84b1acf1ccca Jun 03 01:08:24.448384 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-70cfa5f6-bd62-42d5-b27c-f4741137b7ae req-d3aa2823-d5b4-4a31-b3be-aa07592c1529 service nova] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Received event network-changed-2b07ef45-8a47-47fc-80b4-16b6c45aafa7 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:24.449066 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-70cfa5f6-bd62-42d5-b27c-f4741137b7ae req-d3aa2823-d5b4-4a31-b3be-aa07592c1529 service nova] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Refreshing instance network info cache due to event network-changed-2b07ef45-8a47-47fc-80b4-16b6c45aafa7. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:24.449066 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-70cfa5f6-bd62-42d5-b27c-f4741137b7ae req-d3aa2823-d5b4-4a31-b3be-aa07592c1529 service nova] Acquiring lock "refresh_cache-d4e14707-ef0a-46a8-aa4b-12951363c2e6" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:24.449066 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-70cfa5f6-bd62-42d5-b27c-f4741137b7ae req-d3aa2823-d5b4-4a31-b3be-aa07592c1529 service nova] Acquired lock "refresh_cache-d4e14707-ef0a-46a8-aa4b-12951363c2e6" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:24.449066 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-70cfa5f6-bd62-42d5-b27c-f4741137b7ae req-d3aa2823-d5b4-4a31-b3be-aa07592c1529 service nova] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Refreshing network info cache for port 2b07ef45-8a47-47fc-80b4-16b6c45aafa7 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:24.454401 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Object Instance<6eefbe1c-468b-4294-9f24-7cc661bb3df2> lazy-loaded attributes: flavor,pci_requests {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:08:24.454594 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:08:24.454872 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:24.455121 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:24.533554 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:08:24.541121 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8092b0179794edf9ce6d802adc8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52af3a46de7498c8225030529c1d868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:08:24.734754 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Found WWN 3300000003a0340f0 for multipath device dm-0 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:08:24.735893 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:24.735893 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '3300000003a0340f0', 'path': '/dev/dm-0', 'multipath_id': '3300000003a0340f0'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:24.735893 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003a0340f0', 'path': '/dev/dm-0', 'multipath_id': '3300000003a0340f0'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:08:24.737678 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lazy-loading 'flavor' on Instance uuid 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:24.786062 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:08:24.786238 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:08:24.902759 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "refresh_cache-d4e14707-ef0a-46a8-aa4b-12951363c2e6" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:24.953711 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-70cfa5f6-bd62-42d5-b27c-f4741137b7ae req-d3aa2823-d5b4-4a31-b3be-aa07592c1529 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:24.967256 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Successfully created port: 41fd9876-5f59-4e58-b392-4a1482ee9e7e {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:08:25.028279 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-70cfa5f6-bd62-42d5-b27c-f4741137b7ae req-d3aa2823-d5b4-4a31-b3be-aa07592c1529 service nova] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:08:25.042929 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Booting with volume 64e3bce8-72d3-40a5-bd26-63d9f31890d5 at /dev/vda Jun 03 01:08:25.086239 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:25.099487 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:08:25.118262 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:25.154254 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:08:25.154728 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:08:25.163105 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:08:25.164818 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::bcb4:efff:fe1b:f217', 'fe80::fc16:3eff:fe29:1d7b', 'fe80::fc16:3eff:fe25:b72e', 'fe80::3c0a:faff:fe92:9db2', 'fe80::fc16:3eff:fe2e:c45e', 'fe80::b499:daff:fe68:cfe4', 'fe80::fc16:3eff:fe0b:6e2b', 'fe80::58fc:8ff:fe98:1e95', 'fe80::fc16:3eff:fefb:204b', 'fe80::58e8:72ff:fe3d:6def'] Jun 03 01:08:25.164818 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:08:25.164818 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:08:25.165212 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:25.165285 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Updating existing volume attachment record: c57b2156-6e0c-422b-8db5-28c2d0869243 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:08:25.181283 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-70cfa5f6-bd62-42d5-b27c-f4741137b7ae req-d3aa2823-d5b4-4a31-b3be-aa07592c1529 service nova] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:25.241456 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Attempting to attach volume 8692f17c-5ea5-47f1-8c58-4ae3c5185693 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98288) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 03 01:08:25.243186 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] attach device xml: Jun 03 01:08:25.243186 np0000002000 nova-compute[98288]: Jun 03 01:08:25.243186 np0000002000 nova-compute[98288]: Jun 03 01:08:25.243186 np0000002000 nova-compute[98288]: Jun 03 01:08:25.243186 np0000002000 nova-compute[98288]: Jun 03 01:08:25.243186 np0000002000 nova-compute[98288]: 8692f17c-5ea5-47f1-8c58-4ae3c5185693 Jun 03 01:08:25.243186 np0000002000 nova-compute[98288]: Jun 03 01:08:25.243186 np0000002000 nova-compute[98288]: {{(pid=98288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 03 01:08:25.289206 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:08:25.459583 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4b28c45b-ae9d-437b-a501-8d0ae9fa3974 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "2bdcee06-76d6-431e-bef1-84b1acf1ccca" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.232s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:25.462834 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Successfully updated port: 41fd9876-5f59-4e58-b392-4a1482ee9e7e {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:08:25.683868 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-70cfa5f6-bd62-42d5-b27c-f4741137b7ae req-d3aa2823-d5b4-4a31-b3be-aa07592c1529 service nova] Releasing lock "refresh_cache-d4e14707-ef0a-46a8-aa4b-12951363c2e6" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:25.684208 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquired lock "refresh_cache-d4e14707-ef0a-46a8-aa4b-12951363c2e6" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:25.684378 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:08:25.796018 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.418s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:25.859701 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Deleted allocations for instance 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7 Jun 03 01:08:25.965433 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:25.965433 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquired lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:25.965633 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:08:26.241912 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:08:26.386210 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:26.411687 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:26.411948 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:26.412188 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:26.412396 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:26.412571 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:26.414611 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Terminating instance Jun 03 01:08:26.498948 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98288) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 03 01:08:26.509914 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2b9ecf52-4704-4c0c-b5b6-133e974d0fb4 req-435888b1-0f7a-4e91-8b67-052ef8f841d8 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Received event network-changed-41fd9876-5f59-4e58-b392-4a1482ee9e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:26.510276 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-2b9ecf52-4704-4c0c-b5b6-133e974d0fb4 req-435888b1-0f7a-4e91-8b67-052ef8f841d8 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Refreshing instance network info cache due to event network-changed-41fd9876-5f59-4e58-b392-4a1482ee9e7e. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:26.510455 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2b9ecf52-4704-4c0c-b5b6-133e974d0fb4 req-435888b1-0f7a-4e91-8b67-052ef8f841d8 service nova] Acquiring lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:26.549914 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Updating instance_info_cache with network_info: [{"id": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "address": "fa:16:3e:40:40:4e", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b07ef45-8a", "ovs_interfaceid": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:26.580219 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:26.708131 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:26.869050 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-72359783-89b8-47ea-91af-a57a340d1400 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.643s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:26.896064 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:26.896064 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:26.896064 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:26.896064 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] No VIF found with MAC fa:16:3e:2e:c4:5e, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:08:26.919367 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:08:26.944615 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:26.946767 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:26.974574 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:26.996257 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.007082 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.037243 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:27.054548 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Releasing lock "refresh_cache-d4e14707-ef0a-46a8-aa4b-12951363c2e6" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:27.057459 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Instance network_info: |[{"id": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "address": "fa:16:3e:40:40:4e", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b07ef45-8a", "ovs_interfaceid": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:08:27.201841 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Updating instance_info_cache with network_info: [{"id": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "address": "fa:16:3e:0b:6e:2b", "network": {"id": "246d6702-1aae-400a-8fff-b9cf129f6aeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145522194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff7144f-d5", "ovs_interfaceid": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "address": "fa:16:3e:a2:1a:e1", "network": {"id": "7b4bae06-a890-4930-b64d-de017282f84d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1628608206", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd9876-5f", "ovs_interfaceid": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:27.229947 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.239220 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.255414 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.99971668499984 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:27.257014 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Instance destroyed successfully. Jun 03 01:08:27.260728 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:08:27.262154 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lazy-loading 'resources' on Instance uuid cbb3ba9a-f26f-40c4-ac5b-00470740fd96 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:27.267040 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:08:27.268463 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Creating image(s) Jun 03 01:08:27.268463 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Did not create local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} Jun 03 01:08:27.268777 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Ensure instance console log exists: /opt/stack/data/nova/instances/d4e14707-ef0a-46a8-aa4b-12951363c2e6/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:08:27.269099 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:27.269334 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:27.270238 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:27.270238 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Start _get_guest_xml network_info=[{"id": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "address": "fa:16:3e:40:40:4e", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b07ef45-8a", "ovs_interfaceid": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'c57b2156-6e0c-422b-8db5-28c2d0869243', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd4e14707-ef0a-46a8-aa4b-12951363c2e6', 'attached_at': '', 'detached_at': '', 'volume_id': '64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'serial': '64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'multiattach': True}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:08:27.273408 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:08:27.274586 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-195196529', uuid='d4e14707-ef0a-46a8-aa4b-12951363c2e6'), owner=OwnerMeta(userid='78fb92b522cd485b9d2ea55fa096b4b2', username='tempest-AttachVolumeMultiAttachTest-619856118-project-member', projectid='ac66984846344d438d4d4208f858a38b', projectname='tempest-AttachVolumeMultiAttachTest-619856118'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "address": "fa:16:3e:40:40:4e", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b07ef45-8a", "ovs_interfaceid": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448907.2742534) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:08:27.280430 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:08:27.280430 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:08:27.282467 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:08:27.282467 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:08:27.282835 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:08:27.283191 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:08:27.283467 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:08:27.283645 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:08:27.285460 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:08:27.285460 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:08:27.285460 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:08:27.285460 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:08:27.285460 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:08:27.285460 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:08:27.285460 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:08:27.285460 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:08:27.293323 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:08:27.293836 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:27.294241 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:27.294634 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:27.294932 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:08:27.304871 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:27.305301 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:27.305885 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:27.306135 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:08:27.306981 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:27.307169 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:08:27.317653 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:08:27.317653 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:27.322179 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:08:27.322179 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:27.334604 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5] added Jun 03 01:08:27.334604 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:08:27.334604 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:27.334604 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:27.334604 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:27.334604 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:27.334604 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:27.334865 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:08:27.334914 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0292(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:08:27.335061 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:08:27.344840 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5] added Jun 03 01:08:27.344840 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:08:27.344840 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:27.344840 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:27.344840 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:27.344840 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:27.344840 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:27.345060 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:08:27.345154 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:08:27.345305 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:08:27.464005 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-06816366-e772-4702-b421-16a5fff22a67 req-286e2ccf-de82-4e5b-a51f-6682d783bd75 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Received event network-vif-unplugged-41fd9876-5f59-4e58-b392-4a1482ee9e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:27.464223 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-06816366-e772-4702-b421-16a5fff22a67 req-286e2ccf-de82-4e5b-a51f-6682d783bd75 service nova] Acquiring lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:27.464412 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-06816366-e772-4702-b421-16a5fff22a67 req-286e2ccf-de82-4e5b-a51f-6682d783bd75 service nova] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:27.464569 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-06816366-e772-4702-b421-16a5fff22a67 req-286e2ccf-de82-4e5b-a51f-6682d783bd75 service nova] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:27.464719 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-06816366-e772-4702-b421-16a5fff22a67 req-286e2ccf-de82-4e5b-a51f-6682d783bd75 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] No waiting events found dispatching network-vif-unplugged-41fd9876-5f59-4e58-b392-4a1482ee9e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:27.464871 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-06816366-e772-4702-b421-16a5fff22a67 req-286e2ccf-de82-4e5b-a51f-6682d783bd75 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Received unexpected event network-vif-unplugged-41fd9876-5f59-4e58-b392-4a1482ee9e7e for instance with vm_state active and task_state None. Jun 03 01:08:27.703623 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Releasing lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:27.704141 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2b9ecf52-4704-4c0c-b5b6-133e974d0fb4 req-435888b1-0f7a-4e91-8b67-052ef8f841d8 service nova] Acquired lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:27.704302 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-2b9ecf52-4704-4c0c-b5b6-133e974d0fb4 req-435888b1-0f7a-4e91-8b67-052ef8f841d8 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Refreshing network info cache for port 41fd9876-5f59-4e58-b392-4a1482ee9e7e {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:27.706675 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:07:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-565619882',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-565619882',id=19,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbZ9pKZxlPAaSnxNpNutFnQbBi3kuyPB49DYd+gGlDINebjgMkgajEvEz+1OvuZiqu1lqqUbr7htvJLcQVd34/M9wOa/5NMz3tTbdndj/0vW5a6CvOsqaq3g7g+PdObvA==',key_name='tempest-keypair-1816886568',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:44Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f52af3a46de7498c8225030529c1d868',ramdisk_id='',reservation_id='r-55wspc0r',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1125506206',owner_user_name='tempest-TaggedAttachmentsTest-1125506206-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8092b0179794edf9ce6d802adc8cc8f',uuid=6eefbe1c-468b-4294-9f24-7cc661bb3df2,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "address": "fa:16:3e:a2:1a:e1", "network": {"id": "7b4bae06-a890-4930-b64d-de017282f84d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1628608206", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd9876-5f", "ovs_interfaceid": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:08:27.706861 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Converting VIF {"id": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "address": "fa:16:3e:a2:1a:e1", "network": {"id": "7b4bae06-a890-4930-b64d-de017282f84d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1628608206", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd9876-5f", "ovs_interfaceid": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:27.707473 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:1a:e1,bridge_name='br-int',has_traffic_filtering=True,id=41fd9876-5f59-4e58-b392-4a1482ee9e7e,network=Network(7b4bae06-a890-4930-b64d-de017282f84d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fd9876-5f') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:27.707755 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:1a:e1,bridge_name='br-int',has_traffic_filtering=True,id=41fd9876-5f59-4e58-b392-4a1482ee9e7e,network=Network(7b4bae06-a890-4930-b64d-de017282f84d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fd9876-5f') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:08:27.708134 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.708421 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:27.708678 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:08:27.709349 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.709629 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '100c9625-3c1a-52db-a133-10822ed2909c', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:27.710541 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.711097 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:27.716320 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.718877 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.718989 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41fd9876-5f, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:27.719235 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41fd9876-5f, col_values=(('qos', UUID('13f263b4-1ac3-4b19-9203-74b2a5745360')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:27.719384 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41fd9876-5f, col_values=(('external_ids', {'iface-id': '41fd9876-5f59-4e58-b392-4a1482ee9e7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:1a:e1', 'vm-uuid': '6eefbe1c-468b-4294-9f24-7cc661bb3df2'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:27.720103 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.721314 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:27.728623 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.729225 np0000002000 nova-compute[98288]: INFO os_vif [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:1a:e1,bridge_name='br-int',has_traffic_filtering=True,id=41fd9876-5f59-4e58-b392-4a1482ee9e7e,network=Network(7b4bae06-a890-4930-b64d-de017282f84d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fd9876-5f') Jun 03 01:08:27.729804 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:07:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-565619882',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-565619882',id=19,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbZ9pKZxlPAaSnxNpNutFnQbBi3kuyPB49DYd+gGlDINebjgMkgajEvEz+1OvuZiqu1lqqUbr7htvJLcQVd34/M9wOa/5NMz3tTbdndj/0vW5a6CvOsqaq3g7g+PdObvA==',key_name='tempest-keypair-1816886568',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:44Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f52af3a46de7498c8225030529c1d868',ramdisk_id='',reservation_id='r-55wspc0r',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1125506206',owner_user_name='tempest-TaggedAttachmentsTest-1125506206-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8092b0179794edf9ce6d802adc8cc8f',uuid=6eefbe1c-468b-4294-9f24-7cc661bb3df2,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "address": "fa:16:3e:a2:1a:e1", "network": {"id": "7b4bae06-a890-4930-b64d-de017282f84d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1628608206", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd9876-5f", "ovs_interfaceid": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:08:27.730080 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Converting VIF {"id": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "address": "fa:16:3e:a2:1a:e1", "network": {"id": "7b4bae06-a890-4930-b64d-de017282f84d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1628608206", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd9876-5f", "ovs_interfaceid": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:27.730529 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:1a:e1,bridge_name='br-int',has_traffic_filtering=True,id=41fd9876-5f59-4e58-b392-4a1482ee9e7e,network=Network(7b4bae06-a890-4930-b64d-de017282f84d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fd9876-5f') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:27.731492 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] attach device xml: Jun 03 01:08:27.731492 np0000002000 nova-compute[98288]: Jun 03 01:08:27.731492 np0000002000 nova-compute[98288]: Jun 03 01:08:27.731492 np0000002000 nova-compute[98288]: Jun 03 01:08:27.731492 np0000002000 nova-compute[98288]: Jun 03 01:08:27.731492 np0000002000 nova-compute[98288]: Jun 03 01:08:27.731492 np0000002000 nova-compute[98288]: Jun 03 01:08:27.731492 np0000002000 nova-compute[98288]: {{(pid=98288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 03 01:08:27.746699 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.768809 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-912542477',display_name='tempest-ServerRescueNegativeTestJSON-server-912542477',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverrescuenegativetestjson-server-912542477',id=9,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-03T01:05:45Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='8d71b7749b9b414ea4fb3ad943aebf49',ramdisk_id='',reservation_id='r-8e5i10vc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-335039479',owner_user_name='tempest-ServerRescueNegativeTestJSON-335039479-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:05:52Z,user_data=None,user_id='a97328826b194121a85a35b41129c1a9',uuid=cbb3ba9a-f26f-40c4-ac5b-00470740fd96,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:08:27.769000 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converting VIF {"id": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "address": "fa:16:3e:29:1d:7b", "network": {"id": "869e87a4-1fa9-4035-81ed-78dda98663be", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-483203956-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8d71b7749b9b414ea4fb3ad943aebf49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ca57b5b-fd", "ovs_interfaceid": "6ca57b5b-fdc0-4f99-a76c-1bf9511024a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:27.769422 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:1d:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ca57b5b-fdc0-4f99-a76c-1bf9511024a1,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca57b5b-fd') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:27.769616 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:1d:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ca57b5b-fdc0-4f99-a76c-1bf9511024a1,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca57b5b-fd') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:08:27.771226 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.771477 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ca57b5b-fd, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:27.775880 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:27.777469 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:27.777469 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:27.816505 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.817691 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.817870 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4d58f85-b94e-4c0a-bb94-b1fb50dffe74) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:27.819584 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:27.825027 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:27.826777 np0000002000 nova-compute[98288]: INFO os_vif [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:1d:7b,bridge_name='br-int',has_traffic_filtering=True,id=6ca57b5b-fdc0-4f99-a76c-1bf9511024a1,network=Network(869e87a4-1fa9-4035-81ed-78dda98663be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ca57b5b-fd') Jun 03 01:08:27.827143 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Deleting instance files /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96_del Jun 03 01:08:27.827967 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Deletion of /opt/stack/data/nova/instances/cbb3ba9a-f26f-40c4-ac5b-00470740fd96_del complete Jun 03 01:08:27.847727 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:28.004468 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:28.087855 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:28.106896 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:28.116116 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:28.206576 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-2b9ecf52-4704-4c0c-b5b6-133e974d0fb4 req-435888b1-0f7a-4e91-8b67-052ef8f841d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:28.278545 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Detaching volume ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 Jun 03 01:08:28.334788 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Took 1.42 seconds to destroy the instance on the hypervisor. Jun 03 01:08:28.335582 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:08:28.335997 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:08:28.336529 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:08:28.339585 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:08:28.339585 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:28.345787 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:08:28.348587 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:28.350759 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Attempting to driver detach volume ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 from mountpoint /dev/vdb Jun 03 01:08:28.358161 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Found disk vdb by alias ua-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:08:28.359570 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Found disk vdb by alias ua-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:08:28.360152 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Attempting to detach device vdb from instance d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa from the persistent domain config. {{(pid=98288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 03 01:08:28.360421 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] detach device xml: Jun 03 01:08:28.360421 np0000002000 nova-compute[98288]: Jun 03 01:08:28.360421 np0000002000 nova-compute[98288]: Jun 03 01:08:28.360421 np0000002000 nova-compute[98288]: Jun 03 01:08:28.360421 np0000002000 nova-compute[98288]: Jun 03 01:08:28.360421 np0000002000 nova-compute[98288]: ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 Jun 03 01:08:28.360421 np0000002000 nova-compute[98288]:
Jun 03 01:08:28.360421 np0000002000 nova-compute[98288]: Jun 03 01:08:28.360421 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:08:28.361817 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:28.366479 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:28.374430 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Successfully detached device vdb from instance d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa from the persistent domain config. Jun 03 01:08:28.374623 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] (1/8): Attempting to detach device vdb with device alias ua-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 from instance d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa from the live domain config. {{(pid=98288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 03 01:08:28.374917 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] detach device xml: Jun 03 01:08:28.374917 np0000002000 nova-compute[98288]: Jun 03 01:08:28.374917 np0000002000 nova-compute[98288]: Jun 03 01:08:28.374917 np0000002000 nova-compute[98288]: Jun 03 01:08:28.374917 np0000002000 nova-compute[98288]: Jun 03 01:08:28.374917 np0000002000 nova-compute[98288]: ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 Jun 03 01:08:28.374917 np0000002000 nova-compute[98288]:
Jun 03 01:08:28.374917 np0000002000 nova-compute[98288]: Jun 03 01:08:28.374917 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:08:28.376781 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:28.389919 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.389919 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.389919 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.389919 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.389919 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:28.390175 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsi session list stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.390175 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.390175 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.390175 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.390175 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:28.396689 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.396689 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.396689 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.396689 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.396689 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:28.397200 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsi session list stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.397200 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.397200 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.397200 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.397200 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:28.428716 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5, portal: 192.168.40.100,3260] Jun 03 01:08:28.428716 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5, portal: 192.168.40.100,3260] successful. Jun 03 01:08:28.428716 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:28.439791 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:28.445836 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5, portal: 192.168.50.100,3260] Jun 03 01:08:28.445836 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5, portal: 192.168.50.100,3260] successful. Jun 03 01:08:28.445836 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:28.461022 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7a6610d0-d9f4-4f52-a53f-6c1fb3c7db2e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.436s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:28.462678 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.462678 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.462678 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.462678 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.462678 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:28.462678 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:28.462678 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:28.463590 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsi session list stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.463590 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.463590 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.463590 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.463590 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:28.463590 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:28.463590 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:28.464399 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:28.466177 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:08:28.468558 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:28.469797 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:28.471518 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] HCTL ('9', '-', '-', 0) found on session 42 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:08:28.471651 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] iscsi session list stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:28.486915 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Searching for a device in session 42 and hctl ['9', '*', '*', 0] yield: None {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:08:28.487376 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:28.489660 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:08:28.489660 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] HCTL ('10', '-', '-', 0) found on session 43 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:08:28.489660 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:08:28.504822 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Searching for a device in session 43 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:08:28.504822 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:08:28.609977 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-2b9ecf52-4704-4c0c-b5b6-133e974d0fb4 req-435888b1-0f7a-4e91-8b67-052ef8f841d8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:28.796632 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-2b9ecf52-4704-4c0c-b5b6-133e974d0fb4 req-435888b1-0f7a-4e91-8b67-052ef8f841d8 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Updated VIF entry in instance network info cache for port 41fd9876-5f59-4e58-b392-4a1482ee9e7e. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:08:28.797044 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-2b9ecf52-4704-4c0c-b5b6-133e974d0fb4 req-435888b1-0f7a-4e91-8b67-052ef8f841d8 service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Updating instance_info_cache with network_info: [{"id": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "address": "fa:16:3e:0b:6e:2b", "network": {"id": "246d6702-1aae-400a-8fff-b9cf129f6aeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145522194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff7144f-d5", "ovs_interfaceid": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "address": "fa:16:3e:a2:1a:e1", "network": {"id": "7b4bae06-a890-4930-b64d-de017282f84d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1628608206", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd9876-5f", "ovs_interfaceid": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:28.894598 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d3a5b544-e7c2-404e-a5b2-079d3bafe265 req-4b72947f-0f48-4059-8e58-079d98452850 service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-deleted-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:28.895263 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-d3a5b544-e7c2-404e-a5b2-079d3bafe265 req-4b72947f-0f48-4059-8e58-079d98452850 service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Neutron deleted interface 6ca57b5b-fdc0-4f99-a76c-1bf9511024a1; detaching it from the instance and deleting it from the info cache Jun 03 01:08:28.896495 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d3a5b544-e7c2-404e-a5b2-079d3bafe265 req-4b72947f-0f48-4059-8e58-079d98452850 service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Detach interface failed, port_id=6ca57b5b-fdc0-4f99-a76c-1bf9511024a1, reason: Instance cbb3ba9a-f26f-40c4-ac5b-00470740fd96 could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:08:28.934045 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Received event ua-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42> from libvirt while the driver is waiting for it; dispatched. {{(pid=98288) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 03 01:08:28.935410 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 for instance d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa {{(pid=98288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 03 01:08:28.940190 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Successfully detached device vdb from instance d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa from the live domain config. Jun 03 01:08:28.941136 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:08:28.941676 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, None), 'kwargs': {'force': False}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:28.941799 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:29.132120 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Rescuing Jun 03 01:08:29.132281 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:29.132354 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquired lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:29.132468 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:08:29.286346 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Acquiring lock "c861dfe4-7a78-4098-aa35-8d1f948edb4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:29.286503 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Lock "c861dfe4-7a78-4098-aa35-8d1f948edb4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:29.298631 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-2b9ecf52-4704-4c0c-b5b6-133e974d0fb4 req-435888b1-0f7a-4e91-8b67-052ef8f841d8 service nova] Releasing lock "refresh_cache-6eefbe1c-468b-4294-9f24-7cc661bb3df2" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:29.345192 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:29.379293 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:29.379423 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:29.379564 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] No VIF found with MAC fa:16:3e:0b:6e:2b, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:08:29.489072 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Searching for a device in session 42 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:08:29.489210 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '64e3bce8-72d3-40a5-bd26-63d9f31890d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:08:29.519727 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:29.519727 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:29.519727 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:29.519727 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:29.519727 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] No waiting events found dispatching network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:29.519727 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:08:29.519727 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:29.519727 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] Acquiring lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:29.519727 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:29.519727 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:29.519727 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] No waiting events found dispatching network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:29.519727 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Received event network-vif-unplugged-6ca57b5b-fdc0-4f99-a76c-1bf9511024a1 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:08:29.520316 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Received event network-vif-plugged-41fd9876-5f59-4e58-b392-4a1482ee9e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:29.520587 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] Acquiring lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:29.520784 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:29.520957 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:29.521134 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] No waiting events found dispatching network-vif-plugged-41fd9876-5f59-4e58-b392-4a1482ee9e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:29.521598 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Received unexpected event network-vif-plugged-41fd9876-5f59-4e58-b392-4a1482ee9e7e for instance with vm_state active and task_state None. Jun 03 01:08:29.521798 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Received event network-vif-plugged-41fd9876-5f59-4e58-b392-4a1482ee9e7e {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:29.521992 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] Acquiring lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:29.522177 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:29.522371 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:29.522565 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] No waiting events found dispatching network-vif-plugged-41fd9876-5f59-4e58-b392-4a1482ee9e7e {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:29.522741 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-d9c7d61d-a287-423b-9a12-ae8e74012dc0 req-77c9226c-0317-4401-93ac-f1fd65874faf service nova] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Received unexpected event network-vif-plugged-41fd9876-5f59-4e58-b392-4a1482ee9e7e for instance with vm_state active and task_state None. Jun 03 01:08:29.634222 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:29.788000 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:08:29.847121 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Took 1.51 seconds to deallocate network for instance. Jun 03 01:08:29.884053 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-565619882', uuid='6eefbe1c-468b-4294-9f24-7cc661bb3df2'), owner=OwnerMeta(userid='e8092b0179794edf9ce6d802adc8cc8f', username='tempest-TaggedAttachmentsTest-1125506206-project-member', projectid='f52af3a46de7498c8225030529c1d868', projectname='tempest-TaggedAttachmentsTest-1125506206'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "address": "fa:16:3e:0b:6e:2b", "network": {"id": "246d6702-1aae-400a-8fff-b9cf129f6aeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2145522194-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ff7144f-d5", "ovs_interfaceid": "0ff7144f-d5a9-47c6-9020-ee801a5b02d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "address": "fa:16:3e:a2:1a:e1", "network": {"id": "7b4bae06-a890-4930-b64d-de017282f84d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1628608206", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd9876-5f", "ovs_interfaceid": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448909.8836594) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] set metadata xml: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: tempest-device-tagging-server-565619882 Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: 2026-06-03 01:08:29 Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: 192 Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: True Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: bare Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: ide Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: pc Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: tempest-TaggedAttachmentsTest-1125506206-project-member Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: tempest-TaggedAttachmentsTest-1125506206 Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: Jun 03 01:08:29.884553 np0000002000 nova-compute[98288]: {{(pid=98288) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}} Jun 03 01:08:29.953706 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:30.094366 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Updating instance_info_cache with network_info: [{"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:30.320593 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Found WWN 330000000870493ce for multipath device dm-1 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:08:30.320849 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.026s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:30.321004 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] <== connect_volume: return (3027ms) {'type': 'block', 'scsi_wwn': '330000000870493ce', 'path': '/dev/dm-1', 'multipath_id': '330000000870493ce'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:30.321117 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000870493ce', 'path': '/dev/dm-1', 'multipath_id': '330000000870493ce'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:08:30.321692 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.380s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:30.322112 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:08:30.322292 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:08:30.340522 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:30.340964 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:30.343697 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:08:30.343896 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Claim successful on node np0000002000 Jun 03 01:08:30.347122 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:30.347122 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:30.347122 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:30.347122 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:30.347122 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:30.347122 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:30.347122 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:30.347313 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsi session list stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:30.347313 np0000002000 nova-compute[98288]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42 (non-flash) Jun 03 01:08:30.347313 np0000002000 nova-compute[98288]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:30.347313 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:30.347313 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:30.347313 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:30.347313 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:30.347429 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5', '43')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:08:30.347542 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '38')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:08:30.348557 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42', '39')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:08:30.349449 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Resulting device map defaultdict(. at 0x73e7b01d5d00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42'): ({'sdr'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:08:30.349659 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Removing multipathed devices sdq, sdr {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:08:30.349887 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Flush multipath device 330000000aae5304d {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:08:30.356405 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:30.375681 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:08:30.398059 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7cc6203f-d3ef-4cc2-b219-335b17137024 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "interface-6eefbe1c-468b-4294-9f24-7cc661bb3df2-None" "released" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: held 7.110s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:30.426731 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:08:30.473644 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Checking to see if SCSI volumes sdq, sdr have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:08:30.474022 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] SCSI volumes sdq, sdr have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:08:30.474813 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Checking to see if device paths {'sdq', 'sdr'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:08:30.484355 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Device paths {'sdq', 'sdr'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:08:30.484526 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:08:30.493319 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:30.518933 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42, portal: 192.168.40.100,3260] Jun 03 01:08:30.518933 np0000002000 nova-compute[98288]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42, portal: 192.168.40.100,3260] successful. Jun 03 01:08:30.518933 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:30.532128 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:30.540284 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:30.566970 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42, portal: 192.168.50.100,3260] Jun 03 01:08:30.566970 np0000002000 nova-compute[98288]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-ff4ec3ab-aed7-4d7c-9f93-18a4d5fffe42, portal: 192.168.50.100,3260] successful. Jun 03 01:08:30.566970 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:30.578805 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:30.579006 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:30.579118 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] <== disconnect_volume: return (1637ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:30.579267 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:08:30.596822 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Releasing lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:30.826319 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-195196529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-attachvolumemultiattachtest-server-195196529',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac66984846344d438d4d4208f858a38b',ramdisk_id='',reservation_id='r-obqsb9x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-619856118',owner_user_name='tempest-AttachVolumeMultiAttachTest-619856118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:08:25Z,user_data=None,user_id='78fb92b522cd485b9d2ea55fa096b4b2',uuid=d4e14707-ef0a-46a8-aa4b-12951363c2e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "address": "fa:16:3e:40:40:4e", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b07ef45-8a", "ovs_interfaceid": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:08:30.826535 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Converting VIF {"id": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "address": "fa:16:3e:40:40:4e", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b07ef45-8a", "ovs_interfaceid": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:30.826884 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:40:4e,bridge_name='br-int',has_traffic_filtering=True,id=2b07ef45-8a47-47fc-80b4-16b6c45aafa7,network=Network(b926d00a-7715-4063-bc45-4da20af659f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b07ef45-8a') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:30.827379 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lazy-loading 'pci_devices' on Instance uuid d4e14707-ef0a-46a8-aa4b-12951363c2e6 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:31.125410 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lazy-loading 'flavor' on Instance uuid d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] End _get_guest_xml xml= Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: d4e14707-ef0a-46a8-aa4b-12951363c2e6 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: instance-00000016 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 196608 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: tempest-AttachVolumeMultiAttachTest-server-195196529 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 2026-06-03 01:08:27 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 192 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: True Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: tempest-AttachVolumeMultiAttachTest-619856118-project-member Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: tempest-AttachVolumeMultiAttachTest-619856118 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: d4e14707-ef0a-46a8-aa4b-12951363c2e6 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: d4e14707-ef0a-46a8-aa4b-12951363c2e6 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: hvm Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 128 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: 64e3bce8-72d3-40a5-bd26-63d9f31890d5 Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: Jun 03 01:08:31.330087 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:08:31.332710 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Preparing to wait for external event network-vif-plugged-2b07ef45-8a47-47fc-80b4-16b6c45aafa7 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:08:31.332710 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "d4e14707-ef0a-46a8-aa4b-12951363c2e6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:31.332710 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "d4e14707-ef0a-46a8-aa4b-12951363c2e6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:31.332710 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "d4e14707-ef0a-46a8-aa4b-12951363c2e6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:31.332710 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-195196529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-attachvolumemultiattachtest-server-195196529',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac66984846344d438d4d4208f858a38b',ramdisk_id='',reservation_id='r-obqsb9x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-619856118',owner_user_name='tempest-AttachVolumeMultiAttachTest-619856118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:08:25Z,user_data=None,user_id='78fb92b522cd485b9d2ea55fa096b4b2',uuid=d4e14707-ef0a-46a8-aa4b-12951363c2e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "address": "fa:16:3e:40:40:4e", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b07ef45-8a", "ovs_interfaceid": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:08:31.332710 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Converting VIF {"id": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "address": "fa:16:3e:40:40:4e", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b07ef45-8a", "ovs_interfaceid": "2b07ef45-8a47-47fc-80b4-16b6c45aafa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:31.332710 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:40:4e,bridge_name='br-int',has_traffic_filtering=True,id=2b07ef45-8a47-47fc-80b4-16b6c45aafa7,network=Network(b926d00a-7715-4063-bc45-4da20af659f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b07ef45-8a') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:31.332710 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:40:4e,bridge_name='br-int',has_traffic_filtering=True,id=2b07ef45-8a47-47fc-80b4-16b6c45aafa7,network=Network(b926d00a-7715-4063-bc45-4da20af659f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b07ef45-8a') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:08:31.332710 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:31.333235 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:31.333235 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:08:31.333750 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:31.333933 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '408624a1-bd28-5ba3-8d18-b8a18f5caa1c', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:31.352567 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:31.353220 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:31.355700 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:31.358055 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:31.358261 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b07ef45-8a, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:31.358912 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b07ef45-8a, col_values=(('qos', UUID('d3f09701-50d0-4dcb-ad03-e8ff8bf1efdd')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:31.358912 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b07ef45-8a, col_values=(('external_ids', {'iface-id': '2b07ef45-8a47-47fc-80b4-16b6c45aafa7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:40:4e', 'vm-uuid': 'd4e14707-ef0a-46a8-aa4b-12951363c2e6'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:31.359703 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:31.361881 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:31.365475 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:31.366132 np0000002000 nova-compute[98288]: INFO os_vif [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:40:4e,bridge_name='br-int',has_traffic_filtering=True,id=2b07ef45-8a47-47fc-80b4-16b6c45aafa7,network=Network(b926d00a-7715-4063-bc45-4da20af659f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b07ef45-8a') Jun 03 01:08:31.497481 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:31.497853 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:31.674223 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:08:31.674223 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:08:32.000978 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lazy-loading 'flavor' on Instance uuid 6eefbe1c-468b-4294-9f24-7cc661bb3df2 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:32.133715 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-a2386f72-464c-47c3-8d4e-9cfa3f8a9d76 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.357s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:32.178532 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:08:32.214030 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.216135 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.234734 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.238419 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.258741 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.267627 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.354354 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-3d2c7dff-5415-44b9-909c-0a8b5ddd4694 req-a50de9ad-e5f0-4856-9122-9ae40c669102 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received event network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:32.355125 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-3d2c7dff-5415-44b9-909c-0a8b5ddd4694 req-a50de9ad-e5f0-4856-9122-9ae40c669102 service nova] Acquiring lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:32.355678 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-3d2c7dff-5415-44b9-909c-0a8b5ddd4694 req-a50de9ad-e5f0-4856-9122-9ae40c669102 service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:32.355866 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-3d2c7dff-5415-44b9-909c-0a8b5ddd4694 req-a50de9ad-e5f0-4856-9122-9ae40c669102 service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:32.356101 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-3d2c7dff-5415-44b9-909c-0a8b5ddd4694 req-a50de9ad-e5f0-4856-9122-9ae40c669102 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] No waiting events found dispatching network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:32.356207 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-3d2c7dff-5415-44b9-909c-0a8b5ddd4694 req-a50de9ad-e5f0-4856-9122-9ae40c669102 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received unexpected event network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 for instance with vm_state active and task_state rescuing. Jun 03 01:08:32.386288 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:32.386288 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:32.386288 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:32.386288 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:32.388922 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:32.390059 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Terminating instance Jun 03 01:08:32.497853 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.541269 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.545009 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999708209000119 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:32.545217 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.546582 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Instance destroyed successfully. Jun 03 01:08:32.546970 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lazy-loading 'numa_topology' on Instance uuid 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:32.567466 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.682628 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.342s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:32.683146 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.327s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:32.683455 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:08:32.848298 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.861679 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.890094 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.892994 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:32.892994 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:32.893385 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] No VIF found with MAC fa:16:3e:40:40:4e, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:08:32.893968 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Using config drive Jun 03 01:08:32.895745 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Start destroying the instance on the hypervisor. {{(pid=98288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 03 01:08:32.922861 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.924531 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:32.949144 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.004901 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.006825 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.509s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:33.027965 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.053814 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Attempting a stable device rescue Jun 03 01:08:33.063180 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.125520 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:08:33.125520 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:08:33.135401 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.172325 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.180085 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}} Jun 03 01:08:33.193109 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:08:33.193250 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:08:33.193487 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:33.193675 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:33.198421 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Instance directory exists: not creating {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}} Jun 03 01:08:33.198492 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Creating image(s) Jun 03 01:08:33.199329 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:33.199488 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "/opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:33.199946 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "/opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:33.200250 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:33.241701 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.269708 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999748754000166 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:33.274964 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Instance destroyed successfully. Jun 03 01:08:33.275851 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lazy-loading 'resources' on Instance uuid d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:33.300731 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.325827 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.378673 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5a54e82f-c939-4a81-b16c-ee6080ce920f req-09816ed1-754d-4ed8-8d58-a478e12a417a service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-vif-unplugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:33.378673 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5a54e82f-c939-4a81-b16c-ee6080ce920f req-09816ed1-754d-4ed8-8d58-a478e12a417a service nova] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:33.378673 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5a54e82f-c939-4a81-b16c-ee6080ce920f req-09816ed1-754d-4ed8-8d58-a478e12a417a service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:33.378673 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-5a54e82f-c939-4a81-b16c-ee6080ce920f req-09816ed1-754d-4ed8-8d58-a478e12a417a service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:33.378673 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5a54e82f-c939-4a81-b16c-ee6080ce920f req-09816ed1-754d-4ed8-8d58-a478e12a417a service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] No waiting events found dispatching network-vif-unplugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:33.378673 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-5a54e82f-c939-4a81-b16c-ee6080ce920f req-09816ed1-754d-4ed8-8d58-a478e12a417a service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-vif-unplugged-832eebb3-1a18-433e-8480-9be9f07a10f3 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:08:33.400210 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:33.454686 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '392b5174633d48c4966e5e980fdbcd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cfb864a5c5c4e1e82b50d1ab82711aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:08:33.541290 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Creating config drive at /opt/stack/data/nova/instances/d4e14707-ef0a-46a8-aa4b-12951363c2e6/disk.config Jun 03 01:08:33.544302 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d4e14707-ef0a-46a8-aa4b-12951363c2e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcjbvmln7 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:33.588508 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d4e14707-ef0a-46a8-aa4b-12951363c2e6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcjbvmln7" returned: 0 in 0.044s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:33.615175 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.624220 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:08:33.631461 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.635337 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.668987 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.682656 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.699804 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:08:33.708025 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Object Instance<2ae68109-fd4c-4cb8-ac62-f49800f5ec34> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:08:33.708613 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "0e529a986d1d7c5c73509d75c470c1b8d5de65ca" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:33.709119 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "0e529a986d1d7c5c73509d75c470c1b8d5de65ca" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:33.780454 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:06:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-88756962',display_name='tempest-AttachVolumeNegativeTest-server-88756962',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-attachvolumenegativetest-server-88756962',id=16,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqwEG1wE/LYUqJqqX9xCuGSOA92DqW+UrQXj2OK/5LvrGPc0KfwffJHdw+5DY2u6scKuYb8VqJjBDg2Ja02RXCnesb0BW/pFJnnKEORaoSZ/YCnkWgGriD6aCYoZXykUQ==',key_name='tempest-keypair-2085416467',keypairs=,launch_index=0,launched_at=2026-06-03T01:06:47Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='88e01380196548bbbe8f5f9e9147494b',ramdisk_id='',reservation_id='r-ii3x0nrx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1145310491',owner_user_name='tempest-AttachVolumeNegativeTest-1145310491-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4586ad9e4c304b0fa9a960267667ac64',uuid=d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "832eebb3-1a18-433e-8480-9be9f07a10f3", "address": "fa:16:3e:25:b7:2e", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap832eebb3-1a", "ovs_interfaceid": "832eebb3-1a18-433e-8480-9be9f07a10f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 03 01:08:33.783465 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converting VIF {"id": "832eebb3-1a18-433e-8480-9be9f07a10f3", "address": "fa:16:3e:25:b7:2e", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap832eebb3-1a", "ovs_interfaceid": "832eebb3-1a18-433e-8480-9be9f07a10f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:33.783465 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=832eebb3-1a18-433e-8480-9be9f07a10f3,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832eebb3-1a') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:33.783465 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=832eebb3-1a18-433e-8480-9be9f07a10f3,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832eebb3-1a') {{(pid=98288) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 03 01:08:33.784540 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.784830 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap832eebb3-1a, bridge=br-int, if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:33.785939 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.787782 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:33.798734 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.800333 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.800870 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efb34b46-8b4e-432f-8489-c42c64143ef0) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:33.801712 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.801998 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:33.812617 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.816497 np0000002000 nova-compute[98288]: INFO os_vif [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:b7:2e,bridge_name='br-int',has_traffic_filtering=True,id=832eebb3-1a18-433e-8480-9be9f07a10f3,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap832eebb3-1a') Jun 03 01:08:33.816497 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Deleting instance files /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa_del Jun 03 01:08:33.817372 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.820487 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Deletion of /opt/stack/data/nova/instances/d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa_del complete Jun 03 01:08:33.854956 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.860150 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:33.987384 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Successfully created port: 8c74fc9e-d0c3-4b2a-ba57-ec57f90176dd {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:08:34.054355 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:34.080155 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00042002800000773277 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:34.080155 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:34.080155 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:34.080380 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] VM Stopped (Lifecycle Event) Jun 03 01:08:34.084380 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=1.9814426999998886 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:34.084679 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=1.9810708549998708 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:34.096030 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:34.097549 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:34.097739 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:34.097944 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Attaching volume 3ff78393-7780-4cb6-b40c-f5246a0aef68 to /dev/vdb Jun 03 01:08:34.099151 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:34.135019 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.452s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:34.184285 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:34.190005 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:34.206564 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:08:34.236739 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:34.258893 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Deleted allocations for instance cbb3ba9a-f26f-40c4-ac5b-00470740fd96 Jun 03 01:08:34.288282 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:08:34.288701 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:08:34.298957 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:08:34.299947 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:fe0b:6e2b', 'fe80::58fc:8ff:fe98:1e95', 'fe80::fc16:3eff:fefb:204b', 'fe80::58e8:72ff:fe3d:6def', 'fe80::fc16:3eff:fea2:1ae1', 'fe80::dc76:ddff:fe40:110a', 'fe80::fc16:3eff:fe40:404e', 'fe80::7480:56ff:fe72:5866'] Jun 03 01:08:34.300123 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:08:34.304547 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:08:34.305735 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:34.305735 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Updating existing volume attachment record: 6155d0a7-5d68-4402-ad09-871cc4635dcb {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:08:34.337104 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Took 1.44 seconds to destroy the instance on the hypervisor. Jun 03 01:08:34.339313 np0000002000 nova-compute[98288]: DEBUG oslo.service.backend._common.loopingcall [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98288) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 03 01:08:34.340463 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [-] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Deallocating network for instance {{(pid=98288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 03 01:08:34.340463 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] deallocate_for_instance() {{(pid=98288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 03 01:08:34.340463 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:34.478579 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:34.489391 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:34.501099 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8516d2df-6107-4bad-ae6d-8e2886298a9e req-25500b0b-b59d-4b9c-8eb4-54ac026e92a5 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received event network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:34.501404 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8516d2df-6107-4bad-ae6d-8e2886298a9e req-25500b0b-b59d-4b9c-8eb4-54ac026e92a5 service nova] Acquiring lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:34.501636 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8516d2df-6107-4bad-ae6d-8e2886298a9e req-25500b0b-b59d-4b9c-8eb4-54ac026e92a5 service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:34.501797 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8516d2df-6107-4bad-ae6d-8e2886298a9e req-25500b0b-b59d-4b9c-8eb4-54ac026e92a5 service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:34.503057 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8516d2df-6107-4bad-ae6d-8e2886298a9e req-25500b0b-b59d-4b9c-8eb4-54ac026e92a5 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] No waiting events found dispatching network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:34.503668 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-8516d2df-6107-4bad-ae6d-8e2886298a9e req-25500b0b-b59d-4b9c-8eb4-54ac026e92a5 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received unexpected event network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 for instance with vm_state active and task_state rescuing. Jun 03 01:08:34.520941 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:34.525148 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:34.561877 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:34.587449 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-a6c8a2b7-ddb5-43ce-ad39-0870c4236d25 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 2bdcee06-76d6-431e-bef1-84b1acf1ccca] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:34.636326 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Successfully created port: 123df424-6ed2-46af-8841-b8913863bbff {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:08:34.845657 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:34.850066 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:34.850497 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e529a986d1d7c5c73509d75c470c1b8d5de65ca.part --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:34.906175 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:08:34.906175 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ff78393-7780-4cb6-b40c-f5246a0aef68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:34.906175 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:34.906175 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:34.906478 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ff78393-7780-4cb6-b40c-f5246a0aef68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:08:34.922973 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:34.923391 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:34.923803 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:34.924768 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:08:34.924768 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:34.924920 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:08:34.939871 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:08:34.939871 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:34.948172 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:08:34.948172 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:34.948887 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e529a986d1d7c5c73509d75c470c1b8d5de65ca.part --force-share --output=json" returned: 0 in 0.098s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:34.950745 np0000002000 nova-compute[98288]: DEBUG nova.virt.images [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] 397f9475-42d2-40fb-89ac-1e5ff49bea95 was qcow2, converting to raw {{(pid=98288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 03 01:08:34.950745 np0000002000 nova-compute[98288]: DEBUG nova.privsep.utils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 03 01:08:34.950856 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0e529a986d1d7c5c73509d75c470c1b8d5de65ca.part /opt/stack/data/nova/instances/_base/0e529a986d1d7c5c73509d75c470c1b8d5de65ca.converted {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:34.962899 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68] added Jun 03 01:08:34.962899 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:08:34.962899 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:34.962899 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:34.962899 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:34.962899 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:34.962899 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:34.963558 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:08:34.963725 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0394(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:08:34.963973 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:08:34.965221 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68] added Jun 03 01:08:34.965221 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:08:34.965221 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:34.965221 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:34.965221 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:34.965221 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:34.965221 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:34.966477 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:08:34.966477 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0415(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:08:34.966568 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:08:35.012144 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:35.012144 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] VM Started (Lifecycle Event) Jun 03 01:08:35.124754 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0e529a986d1d7c5c73509d75c470c1b8d5de65ca.part /opt/stack/data/nova/instances/_base/0e529a986d1d7c5c73509d75c470c1b8d5de65ca.converted" returned: 0 in 0.174s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:35.137017 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e529a986d1d7c5c73509d75c470c1b8d5de65ca.converted --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:35.224581 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:08:35.232832 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e529a986d1d7c5c73509d75c470c1b8d5de65ca.converted --force-share --output=json" returned: 0 in 0.097s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:35.233645 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "0e529a986d1d7c5c73509d75c470c1b8d5de65ca" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.524s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:35.236504 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:35.236576 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:35.237507 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "0e529a986d1d7c5c73509d75c470c1b8d5de65ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:35.237887 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "0e529a986d1d7c5c73509d75c470c1b8d5de65ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:35.238150 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:35.240663 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:35.240663 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e529a986d1d7c5c73509d75c470c1b8d5de65ca --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:35.279104 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-721e4a91-2ff5-466a-b546-0343b983a5d5 tempest-ServerRescueNegativeTestJSON-335039479 tempest-ServerRescueNegativeTestJSON-335039479-project-member] Lock "cbb3ba9a-f26f-40c4-ac5b-00470740fd96" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.867s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:35.320159 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0e529a986d1d7c5c73509d75c470c1b8d5de65ca --force-share --output=json" returned: 0 in 0.079s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:35.320586 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0e529a986d1d7c5c73509d75c470c1b8d5de65ca,backing_fmt=raw /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.rescue {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:35.365829 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0e529a986d1d7c5c73509d75c470c1b8d5de65ca,backing_fmt=raw /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.rescue" returned: 0 in 0.045s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:35.366432 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "0e529a986d1d7c5c73509d75c470c1b8d5de65ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.128s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:35.366804 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lazy-loading 'migration_context' on Instance uuid 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:35.458138 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-vif-unplugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:35.458747 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:35.458998 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:35.459159 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:35.459335 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] No waiting events found dispatching network-vif-unplugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:35.459527 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-vif-unplugged-832eebb3-1a18-433e-8480-9be9f07a10f3 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:08:35.459677 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-vif-plugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:35.459837 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:35.460006 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:35.460146 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:35.460312 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] No waiting events found dispatching network-vif-plugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:35.460507 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received unexpected event network-vif-plugged-832eebb3-1a18-433e-8480-9be9f07a10f3 for instance with vm_state active and task_state deleting. Jun 03 01:08:35.460669 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-vif-plugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:35.460813 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:35.461480 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:35.461615 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:35.461752 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] No waiting events found dispatching network-vif-plugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:35.461919 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received unexpected event network-vif-plugged-832eebb3-1a18-433e-8480-9be9f07a10f3 for instance with vm_state active and task_state deleting. Jun 03 01:08:35.462062 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-vif-unplugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:35.462227 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:35.462397 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:35.462548 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:35.462671 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] No waiting events found dispatching network-vif-unplugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:35.462779 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-vif-unplugged-832eebb3-1a18-433e-8480-9be9f07a10f3 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:08:35.462878 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-vif-unplugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:35.463003 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Acquiring lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:35.463103 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:35.463231 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:35.463397 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] No waiting events found dispatching network-vif-unplugged-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:35.463606 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-vif-unplugged-832eebb3-1a18-433e-8480-9be9f07a10f3 for instance with task_state deleting. {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 03 01:08:35.463728 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Received event network-vif-plugged-2b07ef45-8a47-47fc-80b4-16b6c45aafa7 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:35.463898 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Acquiring lock "d4e14707-ef0a-46a8-aa4b-12951363c2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:35.464064 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d4e14707-ef0a-46a8-aa4b-12951363c2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:35.464175 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d4e14707-ef0a-46a8-aa4b-12951363c2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:35.464278 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Processing event network-vif-plugged-2b07ef45-8a47-47fc-80b4-16b6c45aafa7 {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:08:35.464410 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Received event network-vif-plugged-2b07ef45-8a47-47fc-80b4-16b6c45aafa7 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:35.464803 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Acquiring lock "d4e14707-ef0a-46a8-aa4b-12951363c2e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:35.464913 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d4e14707-ef0a-46a8-aa4b-12951363c2e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:35.465019 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] Lock "d4e14707-ef0a-46a8-aa4b-12951363c2e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:35.465602 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:08:35.466150 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] No waiting events found dispatching network-vif-plugged-2b07ef45-8a47-47fc-80b4-16b6c45aafa7 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:35.466266 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Received unexpected event network-vif-plugged-2b07ef45-8a47-47fc-80b4-16b6c45aafa7 for instance with vm_state building and task_state spawning. Jun 03 01:08:35.466358 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Received event network-vif-deleted-832eebb3-1a18-433e-8480-9be9f07a10f3 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:35.466682 np0000002000 nova-compute[98288]: INFO nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Neutron deleted interface 832eebb3-1a18-433e-8480-9be9f07a10f3; detaching it from the instance and deleting it from the info cache Jun 03 01:08:35.470158 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:08:35.470826 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-df6c8cee-9e93-4b7d-8a9a-6692e377f9cd req-4f97b996-72eb-4124-bc02-acbbe43626ae service nova] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Detach interface failed, port_id=832eebb3-1a18-433e-8480-9be9f07a10f3, reason: Instance d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa could not be found. {{(pid=98288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 03 01:08:35.472281 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Instance spawned successfully. Jun 03 01:08:35.472696 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:08:35.490096 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Successfully created port: d87a756b-eaae-4f37-8617-80e0bde7e645 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:08:35.513531 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:35.515997 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:08:35.702237 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [-] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:35.731910 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Booting with volume 45521e37-c85f-4d22-92dd-4c870fc9ff14 at /dev/vda Jun 03 01:08:35.774003 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:35.787902 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:08:35.818452 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:35.870874 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:08:35.871505 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:08:35.873219 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Object Instance<2ae68109-fd4c-4cb8-ac62-f49800f5ec34> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:08:35.873611 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:08:35.876219 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Start _get_guest_xml network_info=[{"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "vif_mac": "fa:16:3e:2e:c4:5e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue={'image_id': '397f9475-42d2-40fb-89ac-1e5ff49bea95', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '8779d6b3-ad26-436d-abc8-34575710b200', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '2ae68109-fd4c-4cb8-ac62-f49800f5ec34', 'attached_at': '', 'detached_at': '', 'volume_id': '8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'serial': '8692f17c-5ea5-47f1-8c58-4ae3c5185693'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:08:35.876727 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lazy-loading 'resources' on Instance uuid 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:35.885790 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:08:35.890740 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:fe0b:6e2b', 'fe80::58fc:8ff:fe98:1e95', 'fe80::fc16:3eff:fefb:204b', 'fe80::58e8:72ff:fe3d:6def', 'fe80::fc16:3eff:fea2:1ae1', 'fe80::dc76:ddff:fe40:110a', 'fe80::fc16:3eff:fe40:404e', 'fe80::7480:56ff:fe72:5866'] Jun 03 01:08:35.890740 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:08:35.894311 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:08:35.894311 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:35.894311 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Updating existing volume attachment record: c19c4674-2b6b-48be-b09c-0c8a11e9ce03 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:08:35.964579 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:08:35.968033 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:08:35.981135 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:35.984351 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:35.984351 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:35.984351 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:35.984351 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:35.984351 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:35.984351 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:08:35.993466 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:36.002659 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:36.012332 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:36.022240 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:08:36.022846 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:36.022846 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] VM Paused (Lifecycle Event) Jun 03 01:08:36.024368 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.024368 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.024368 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.024368 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.024368 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:36.024368 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.024368 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.024368 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.024368 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.024368 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:36.032646 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.032646 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.032646 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.032646 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.032646 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:36.032646 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.032646 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.032646 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.032646 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.032646 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:36.054757 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Successfully created port: e07149b8-1bb8-4152-8a93-34bac5a39f44 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:08:36.067881 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.002092719000074794 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:36.068018 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:36.068332 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=6.186897858999828 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:36.068532 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=6.186424818999967 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:36.068879 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68, portal: 192.168.40.100,3260] Jun 03 01:08:36.068879 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68, portal: 192.168.40.100,3260] successful. Jun 03 01:08:36.068879 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:36.069339 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:36.069560 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] VM Stopped (Lifecycle Event) Jun 03 01:08:36.078882 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68, portal: 192.168.50.100,3260] Jun 03 01:08:36.078882 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68, portal: 192.168.50.100,3260] successful. Jun 03 01:08:36.078882 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:36.084642 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:36.095479 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:36.100723 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.100723 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.100723 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.100723 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.100723 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:36.100723 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:36.100723 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:36.100969 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.100969 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.100969 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.100969 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.100969 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:36.100969 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:36.100969 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:36.101711 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:36.101711 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:08:36.103220 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] HCTL ('11', '-', '-', 0) found on session 44 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:08:36.103404 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:08:36.114619 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.114619 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.114619 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.114619 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.114619 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:36.114619 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:36.114619 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:36.114961 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.114961 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:36.114961 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.114961 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:36.114961 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:36.114961 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:36.114961 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:36.115534 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:36.115661 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:08:36.116296 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] HCTL ('12', '-', '-', 0) found on session 45 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:08:36.116385 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:08:36.124040 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Searching for a device in session 44 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:08:36.124040 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ff78393-7780-4cb6-b40c-f5246a0aef68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:08:36.135037 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Searching for a device in session 45 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:08:36.135267 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3ff78393-7780-4cb6-b40c-f5246a0aef68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:08:36.206846 np0000002000 nova-compute[98288]: INFO nova.compute.manager [-] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Took 1.87 seconds to deallocate network for instance. Jun 03 01:08:36.382214 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Object Instance<2ae68109-fd4c-4cb8-ac62-f49800f5ec34> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:08:36.383908 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:08:36.385456 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-739464815', uuid='2ae68109-fd4c-4cb8-ac62-f49800f5ec34'), owner=OwnerMeta(userid='b482a336677a42c3b1cf5c9268771151', username='tempest-ServerStableDeviceRescueTest-945622888-project-member', projectid='a2a3f095839e4616a6f1efd27c8d5e7e', projectname='tempest-ServerStableDeviceRescueTest-945622888'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "vif_mac": "fa:16:3e:2e:c4:5e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448916.3849347) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:08:36.387113 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:08:36.387113 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:08:36.387666 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:08:36.387942 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:08:36.388934 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:08:36.391192 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:08:36.391192 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:08:36.391192 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:08:36.391192 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:08:36.391192 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:08:36.391192 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:08:36.391192 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:08:36.391192 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:08:36.391192 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:08:36.391192 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:08:36.391192 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:08:36.391192 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:36.585847 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:36.587694 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-fc9c5515-24d4-4bc4-8225-2a29442da447 tempest-VolumesAdminNegativeTest-1180237631 tempest-VolumesAdminNegativeTest-1180237631-project-member] [instance: 0fb541a5-5ef7-4781-b65e-d9e2b38f2aa7] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:36.589571 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Took 9.33 seconds to spawn the instance on the hypervisor. Jun 03 01:08:36.589775 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:36.606249 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Successfully created port: 58bc32a7-25f9-4a71-a78d-4727002c1ed0 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:08:36.614599 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:36.614941 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] VM Resumed (Lifecycle Event) Jun 03 01:08:36.715402 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:36.715673 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:36.892627 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Object Instance<2ae68109-fd4c-4cb8-ac62-f49800f5ec34> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:08:36.915411 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.config --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:36.931947 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:08:37.022082 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.config --force-share --output=json" returned: 0 in 0.109s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:37.023005 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:37.023005 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "/opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:37.023195 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "/opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:37.023615 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:08:37.024007 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:37.024188 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:37.123563 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:37.134739 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Took 16.52 seconds to build instance. Jun 03 01:08:37.136827 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: d4e14707-ef0a-46a8-aa4b-12951363c2e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:08:37.196414 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:08:37.196722 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:08:37.243409 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Successfully updated port: 8c74fc9e-d0c3-4b2a-ba57-ec57f90176dd {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:08:37.303813 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-ff5908b5-26d1-4ee3-8114-045d59d910bf req-60915079-151a-4431-ab56-7732073876f9 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Received event network-changed-8c74fc9e-d0c3-4b2a-ba57-ec57f90176dd {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:37.303813 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-ff5908b5-26d1-4ee3-8114-045d59d910bf req-60915079-151a-4431-ab56-7732073876f9 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing instance network info cache due to event network-changed-8c74fc9e-d0c3-4b2a-ba57-ec57f90176dd. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:37.303813 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ff5908b5-26d1-4ee3-8114-045d59d910bf req-60915079-151a-4431-ab56-7732073876f9 service nova] Acquiring lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:37.303813 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ff5908b5-26d1-4ee3-8114-045d59d910bf req-60915079-151a-4431-ab56-7732073876f9 service nova] Acquired lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:37.303813 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-ff5908b5-26d1-4ee3-8114-045d59d910bf req-60915079-151a-4431-ab56-7732073876f9 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing network info cache for port 8c74fc9e-d0c3-4b2a-ba57-ec57f90176dd {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:37.485498 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:37.643739 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-b3392a45-3782-40ec-8dff-6267f02e4044 tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "d4e14707-ef0a-46a8-aa4b-12951363c2e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.035s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:37.686531 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Booting with volume 2684365a-7228-4033-ba26-4edcdba3d417 at /dev/vdb Jun 03 01:08:37.699706 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:08:37.721622 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:37.732583 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:08:37.767071 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:37.802163 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:08:37.802497 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:08:37.807203 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-ff5908b5-26d1-4ee3-8114-045d59d910bf req-60915079-151a-4431-ab56-7732073876f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:37.813180 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:08:37.814223 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:fe0b:6e2b', 'fe80::58fc:8ff:fe98:1e95', 'fe80::fc16:3eff:fefb:204b', 'fe80::58e8:72ff:fe3d:6def', 'fe80::fc16:3eff:fea2:1ae1', 'fe80::dc76:ddff:fe40:110a', 'fe80::fc16:3eff:fe40:404e', 'fe80::7480:56ff:fe72:5866'] Jun 03 01:08:37.814373 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:08:37.814452 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:08:37.814664 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:37.814882 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Updating existing volume attachment record: 7c327907-cf9f-4b41-aaa3-fbf1931f930d {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:08:37.899343 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-ff5908b5-26d1-4ee3-8114-045d59d910bf req-60915079-151a-4431-ab56-7732073876f9 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:08:37.973700 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Found WWN 3300000008ef74a8a for multipath device dm-4 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:08:37.974465 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.068s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:37.975029 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] <== connect_volume: return (3069ms) {'type': 'block', 'scsi_wwn': '3300000008ef74a8a', 'path': '/dev/dm-4', 'multipath_id': '3300000008ef74a8a'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:37.975195 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008ef74a8a', 'path': '/dev/dm-4', 'multipath_id': '3300000008ef74a8a'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:08:37.975654 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.951s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:37.976245 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:08:37.980085 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lazy-loading 'flavor' on Instance uuid 6eefbe1c-468b-4294-9f24-7cc661bb3df2 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:37.991143 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:37.991907 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:37.992580 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:37.992944 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:08:37.993641 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:37.993886 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:08:38.007373 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.startup = automatic Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.scan = manual Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:08:38.010178 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.startup = automatic Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.scan = manual Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:08:38.020289 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:38.027938 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:38.033783 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:38.046950 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-ff5908b5-26d1-4ee3-8114-045d59d910bf req-60915079-151a-4431-ab56-7732073876f9 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:38.052482 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:38.052848 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:38.052848 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] HCTL ('8', '0', '0', 0) found on session 41 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:08:38.054049 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.061s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:38.054654 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:08:38.054854 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] HCTL ('7', '0', '0', 0) found on session 40 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:08:38.054854 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:08:38.067330 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Searching for a device in session 41 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:08:38.067540 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:08:38.068433 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Searching for a device in session 40 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:08:38.068433 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8692f17c-5ea5-47f1-8c58-4ae3c5185693', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:08:38.208028 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.492s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:38.259725 np0000002000 nova-compute[98288]: INFO nova.scheduler.client.report [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Deleted allocations for instance d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa Jun 03 01:08:38.352382 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Successfully updated port: ddd8215e-3724-44f6-be74-72c71a64db34 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:08:38.403744 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-141e4aee-9669-406d-b292-e58694f27180 req-de3663c4-dc83-41dd-a16e-a3eb4b286e93 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Received event network-changed-ddd8215e-3724-44f6-be74-72c71a64db34 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:38.407387 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-141e4aee-9669-406d-b292-e58694f27180 req-de3663c4-dc83-41dd-a16e-a3eb4b286e93 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing instance network info cache due to event network-changed-ddd8215e-3724-44f6-be74-72c71a64db34. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:38.407692 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-141e4aee-9669-406d-b292-e58694f27180 req-de3663c4-dc83-41dd-a16e-a3eb4b286e93 service nova] Acquiring lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:38.484929 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Attempting to attach volume 3ff78393-7780-4cb6-b40c-f5246a0aef68 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98288) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 03 01:08:38.486242 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] attach device xml: Jun 03 01:08:38.486242 np0000002000 nova-compute[98288]: Jun 03 01:08:38.486242 np0000002000 nova-compute[98288]: Jun 03 01:08:38.486242 np0000002000 nova-compute[98288]: Jun 03 01:08:38.486242 np0000002000 nova-compute[98288]: Jun 03 01:08:38.486242 np0000002000 nova-compute[98288]: 3ff78393-7780-4cb6-b40c-f5246a0aef68 Jun 03 01:08:38.486242 np0000002000 nova-compute[98288]: Jun 03 01:08:38.486242 np0000002000 nova-compute[98288]: {{(pid=98288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 03 01:08:38.549935 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ff5908b5-26d1-4ee3-8114-045d59d910bf req-60915079-151a-4431-ab56-7732073876f9 service nova] Releasing lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:38.553750 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-141e4aee-9669-406d-b292-e58694f27180 req-de3663c4-dc83-41dd-a16e-a3eb4b286e93 service nova] Acquired lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:38.553886 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-141e4aee-9669-406d-b292-e58694f27180 req-de3663c4-dc83-41dd-a16e-a3eb4b286e93 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing network info cache for port ddd8215e-3724-44f6-be74-72c71a64db34 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:38.802010 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:38.993260 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:08:39.058117 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-141e4aee-9669-406d-b292-e58694f27180 req-de3663c4-dc83-41dd-a16e-a3eb4b286e93 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:39.137939 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-141e4aee-9669-406d-b292-e58694f27180 req-de3663c4-dc83-41dd-a16e-a3eb4b286e93 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:08:39.270213 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-ab9e0a83-27d2-4ffc-8214-64657bc26289 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 6.884s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:39.411389 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-141e4aee-9669-406d-b292-e58694f27180 req-de3663c4-dc83-41dd-a16e-a3eb4b286e93 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:39.442667 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Booting with volume ce6b2375-c8c8-4aad-8827-dc52065638b8 at /dev/vdc Jun 03 01:08:39.491455 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Successfully updated port: 526f62a9-7cd1-4340-8c1a-7c97514555c3 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:08:39.491924 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:39.502542 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:08:39.524223 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "f105ef75-cffa-4f4d-a782-a5470dd30f0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:39.524419 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "f105ef75-cffa-4f4d-a782-a5470dd30f0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:39.532040 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:39.556283 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b36a7493-d1e4-49f1-b2dd-75e2bfef17cf req-f736a295-279e-4939-b8f6-718a29ed9d23 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Received event network-changed-526f62a9-7cd1-4340-8c1a-7c97514555c3 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:39.556486 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-b36a7493-d1e4-49f1-b2dd-75e2bfef17cf req-f736a295-279e-4939-b8f6-718a29ed9d23 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing instance network info cache due to event network-changed-526f62a9-7cd1-4340-8c1a-7c97514555c3. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:39.556762 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b36a7493-d1e4-49f1-b2dd-75e2bfef17cf req-f736a295-279e-4939-b8f6-718a29ed9d23 service nova] Acquiring lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:39.579628 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:08:39.579979 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:08:39.589271 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:08:39.590792 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:fe0b:6e2b', 'fe80::58fc:8ff:fe98:1e95', 'fe80::fc16:3eff:fefb:204b', 'fe80::58e8:72ff:fe3d:6def', 'fe80::fc16:3eff:fea2:1ae1', 'fe80::dc76:ddff:fe40:110a', 'fe80::fc16:3eff:fe40:404e', 'fe80::7480:56ff:fe72:5866'] Jun 03 01:08:39.590989 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:08:39.591158 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:08:39.591544 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:39.591799 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Updating existing volume attachment record: 7d5322fd-ea00-40d7-8ed2-33871a4edc88 {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:08:39.914022 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-141e4aee-9669-406d-b292-e58694f27180 req-de3663c4-dc83-41dd-a16e-a3eb4b286e93 service nova] Releasing lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:39.914674 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b36a7493-d1e4-49f1-b2dd-75e2bfef17cf req-f736a295-279e-4939-b8f6-718a29ed9d23 service nova] Acquired lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:39.914674 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-b36a7493-d1e4-49f1-b2dd-75e2bfef17cf req-f736a295-279e-4939-b8f6-718a29ed9d23 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing network info cache for port 526f62a9-7cd1-4340-8c1a-7c97514555c3 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:40.010684 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Found WWN 3300000003a0340f0 for multipath device dm-0 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:08:40.011097 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.036s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:40.011243 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] <== connect_volume: return (2986ms) {'type': 'block', 'scsi_wwn': '3300000003a0340f0', 'path': '/dev/dm-0', 'multipath_id': '3300000003a0340f0'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:40.012467 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003a0340f0', 'path': '/dev/dm-0', 'multipath_id': '3300000003a0340f0'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:08:40.028775 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:08:40.154878 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:40.155296 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:40.155296 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] No VIF found with MAC fa:16:3e:0b:6e:2b, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:08:40.416868 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-b36a7493-d1e4-49f1-b2dd-75e2bfef17cf req-f736a295-279e-4939-b8f6-718a29ed9d23 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:40.493768 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-b36a7493-d1e4-49f1-b2dd-75e2bfef17cf req-f736a295-279e-4939-b8f6-718a29ed9d23 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:08:40.522991 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:07:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-739464815',display_name='tempest-ServerStableDeviceRescueTest-server-739464815',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-serverstabledevicerescuetest-server-739464815',id=18,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL4uaTRkCs5om2btENDK/YTPB1lzuMHJcKzLndcGBlnI5Kz04RXQ+W7oGWRWPiV35Rc0mZNAN6Y5n5UIt8TGUuyjlFMoXUbXgAtDbLgM5TCSWesRgzhOSlJUjuLGOFJDg==',key_name='tempest-keypair-1226587213',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:31Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='a2a3f095839e4616a6f1efd27c8d5e7e',ramdisk_id='',reservation_id='r-v6hw0fdo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-945622888',owner_user_name='tempest-ServerStableDeviceRescueTest-945622888-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b482a336677a42c3b1cf5c9268771151',uuid=2ae68109-fd4c-4cb8-ac62-f49800f5ec34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "vif_mac": "fa:16:3e:2e:c4:5e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:08:40.523250 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Converting VIF {"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "vif_mac": "fa:16:3e:2e:c4:5e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:40.524101 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:c4:5e,bridge_name='br-int',has_traffic_filtering=True,id=49f6412d-4366-42e3-a2f7-19a20cc8c032,network=Network(6866ea75-ee2b-4dbc-87c7-4617f6e4222d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49f6412d-43') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:40.526331 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:40.564290 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Successfully updated port: 123df424-6ed2-46af-8841-b8913863bbff {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:08:40.590068 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:40.590416 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:40.594041 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:08:40.594204 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Claim successful on node np0000002000 Jun 03 01:08:40.638846 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-9baca429-9ff3-4f8d-8523-cc8cf603a4d4 req-affdb23a-fd57-4a39-8602-6984b38da3f7 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Received event network-changed-123df424-6ed2-46af-8841-b8913863bbff {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:40.640264 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-9baca429-9ff3-4f8d-8523-cc8cf603a4d4 req-affdb23a-fd57-4a39-8602-6984b38da3f7 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing instance network info cache due to event network-changed-123df424-6ed2-46af-8841-b8913863bbff. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:40.640388 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-9baca429-9ff3-4f8d-8523-cc8cf603a4d4 req-affdb23a-fd57-4a39-8602-6984b38da3f7 service nova] Acquiring lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:40.651116 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-b36a7493-d1e4-49f1-b2dd-75e2bfef17cf req-f736a295-279e-4939-b8f6-718a29ed9d23 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:41.028407 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Object Instance<2ae68109-fd4c-4cb8-ac62-f49800f5ec34> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] End _get_guest_xml xml= Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: instance-00000012 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 196608 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: tempest-ServerStableDeviceRescueTest-server-739464815 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 2026-06-03 01:08:36 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 192 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: True Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: bare Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: ide Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: pc Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: tempest-ServerStableDeviceRescueTest-945622888-project-member Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: tempest-ServerStableDeviceRescueTest-945622888 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: hvm Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 128 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: 8692f17c-5ea5-47f1-8c58-4ae3c5185693 Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: Jun 03 01:08:41.030510 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:08:41.038412 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Instance destroyed successfully. Jun 03 01:08:41.141972 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Acquiring lock "731d6dce-0633-4f07-98af-b6da39e18417" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:41.141972 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "731d6dce-0633-4f07-98af-b6da39e18417" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:41.154007 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-b36a7493-d1e4-49f1-b2dd-75e2bfef17cf req-f736a295-279e-4939-b8f6-718a29ed9d23 service nova] Releasing lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:41.154413 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-9baca429-9ff3-4f8d-8523-cc8cf603a4d4 req-affdb23a-fd57-4a39-8602-6984b38da3f7 service nova] Acquired lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:41.154614 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-9baca429-9ff3-4f8d-8523-cc8cf603a4d4 req-affdb23a-fd57-4a39-8602-6984b38da3f7 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing network info cache for port 123df424-6ed2-46af-8841-b8913863bbff {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:41.600157 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lazy-loading 'flavor' on Instance uuid 731d6dce-0633-4f07-98af-b6da39e18417 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:41.656642 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-9baca429-9ff3-4f8d-8523-cc8cf603a4d4 req-affdb23a-fd57-4a39-8602-6984b38da3f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:41.675918 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Successfully updated port: d87a756b-eaae-4f37-8617-80e0bde7e645 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:08:41.703386 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:08:41.705212 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:08:41.705476 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Creating image(s) Jun 03 01:08:41.705820 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Did not create local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}} Jun 03 01:08:41.705964 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Ensure instance console log exists: /opt/stack/data/nova/instances/c861dfe4-7a78-4098-aa35-8d1f948edb4d/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:08:41.706221 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:41.706394 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:41.706554 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:41.725543 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-86aacf4f-2009-4fed-8192-2c4dc9d56705 req-9ca8ea9a-6e4d-4e71-9edc-653b603f7405 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Received event network-changed-d87a756b-eaae-4f37-8617-80e0bde7e645 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:41.725543 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-86aacf4f-2009-4fed-8192-2c4dc9d56705 req-9ca8ea9a-6e4d-4e71-9edc-653b603f7405 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing instance network info cache due to event network-changed-d87a756b-eaae-4f37-8617-80e0bde7e645. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:41.725543 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-86aacf4f-2009-4fed-8192-2c4dc9d56705 req-9ca8ea9a-6e4d-4e71-9edc-653b603f7405 service nova] Acquiring lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:41.739121 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-58f03097-a9d8-47a5-a548-896435682c8a tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.641s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:41.755834 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-9baca429-9ff3-4f8d-8523-cc8cf603a4d4 req-affdb23a-fd57-4a39-8602-6984b38da3f7 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:08:41.921986 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-9baca429-9ff3-4f8d-8523-cc8cf603a4d4 req-affdb23a-fd57-4a39-8602-6984b38da3f7 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:41.968255 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:08:41.968517 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:08:42.105759 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Ignoring supplied device name: /dev/vdb Jun 03 01:08:42.155870 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "9b3ac820-6802-4d93-abe4-e6f8ad2d7f55" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:42.156073 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "9b3ac820-6802-4d93-abe4-e6f8ad2d7f55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:42.255554 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005115160001878394 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:42.256175 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:42.256410 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:42.256694 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] VM Stopped (Lifecycle Event) Jun 03 01:08:42.257767 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=5.285554085000058 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:42.257981 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=5.28531163599996 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:42.427029 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-9baca429-9ff3-4f8d-8523-cc8cf603a4d4 req-affdb23a-fd57-4a39-8602-6984b38da3f7 service nova] Releasing lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:42.427488 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-86aacf4f-2009-4fed-8192-2c4dc9d56705 req-9ca8ea9a-6e4d-4e71-9edc-653b603f7405 service nova] Acquired lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:42.428694 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-86aacf4f-2009-4fed-8192-2c4dc9d56705 req-9ca8ea9a-6e4d-4e71-9edc-653b603f7405 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing network info cache for port d87a756b-eaae-4f37-8617-80e0bde7e645 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:42.471058 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:08:42.560148 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:42.560325 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:42.560507 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:42.560670 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:42.560808 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] No VIF found with MAC fa:16:3e:2e:c4:5e, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:08:42.562359 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Using config drive Jun 03 01:08:42.611137 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "731d6dce-0633-4f07-98af-b6da39e18417" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:42.657760 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:08:42.717629 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Successfully updated port: e07149b8-1bb8-4152-8a93-34bac5a39f44 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:08:42.759056 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-30913d9e-0628-4454-8a47-8fbbacf3507e tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: cbb3ba9a-f26f-40c4-ac5b-00470740fd96] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:42.874517 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d0ebc82f-c855-4516-b4ff-346f1dc33919 req-6d86f97b-2b64-4c0e-b40a-759bfb30ee5d service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Received event network-changed-e07149b8-1bb8-4152-8a93-34bac5a39f44 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:42.874660 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-d0ebc82f-c855-4516-b4ff-346f1dc33919 req-6d86f97b-2b64-4c0e-b40a-759bfb30ee5d service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing instance network info cache due to event network-changed-e07149b8-1bb8-4152-8a93-34bac5a39f44. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:42.874852 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d0ebc82f-c855-4516-b4ff-346f1dc33919 req-6d86f97b-2b64-4c0e-b40a-759bfb30ee5d service nova] Acquiring lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:42.930738 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-86aacf4f-2009-4fed-8192-2c4dc9d56705 req-9ca8ea9a-6e4d-4e71-9edc-653b603f7405 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:42.979939 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.389s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:42.980410 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:08:43.009486 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:43.016714 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-86aacf4f-2009-4fed-8192-2c4dc9d56705 req-9ca8ea9a-6e4d-4e71-9edc-653b603f7405 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:08:43.068375 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lazy-loading 'ec2_ids' on Instance uuid 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:43.168738 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-86aacf4f-2009-4fed-8192-2c4dc9d56705 req-9ca8ea9a-6e4d-4e71-9edc-653b603f7405 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:43.210556 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:43.211071 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:43.216823 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 03 01:08:43.217332 np0000002000 nova-compute[98288]: INFO nova.compute.claims [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Claim successful on node np0000002000 Jun 03 01:08:43.270376 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:43.270541 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:43.485737 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:08:43.486132 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:08:43.486404 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:43.486673 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:43.564232 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78fb92b522cd485b9d2ea55fa096b4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac66984846344d438d4d4208f858a38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:08:43.571320 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Object Instance<2ae68109-fd4c-4cb8-ac62-f49800f5ec34> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:08:43.571493 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lazy-loading 'keypairs' on Instance uuid 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:43.674100 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-86aacf4f-2009-4fed-8192-2c4dc9d56705 req-9ca8ea9a-6e4d-4e71-9edc-653b603f7405 service nova] Releasing lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:43.676132 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d0ebc82f-c855-4516-b4ff-346f1dc33919 req-6d86f97b-2b64-4c0e-b40a-759bfb30ee5d service nova] Acquired lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:43.676493 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-d0ebc82f-c855-4516-b4ff-346f1dc33919 req-6d86f97b-2b64-4c0e-b40a-759bfb30ee5d service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing network info cache for port e07149b8-1bb8-4152-8a93-34bac5a39f44 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:43.696777 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Successfully updated port: 58bc32a7-25f9-4a71-a78d-4727002c1ed0 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:08:43.698089 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Acquiring lock "731d6dce-0633-4f07-98af-b6da39e18417" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:43.698325 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "731d6dce-0633-4f07-98af-b6da39e18417" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:43.699274 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Attaching volume 75b12252-4c73-488f-beaa-23a5c0dd078c to /dev/vdb Jun 03 01:08:43.739839 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.177', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000002000', 'execute': None}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:43.749455 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.scaleio [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98288) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 03 01:08:43.766233 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Running cmd (subprocess): nvme version {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:43.778336 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Detaching volume 3ff78393-7780-4cb6-b40c-f5246a0aef68 Jun 03 01:08:43.797296 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] 'nvme version' failed. Not Retrying. {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 03 01:08:43.798241 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] nvme not present on system {{(pid=98288) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 03 01:08:43.803582 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:43.805142 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98288) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 03 01:08:43.806573 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.lightos [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Current host hostNQN and IP(s) are ['10.4.3.177', 'fe80::f816:3eff:fe7f:9610', '192.168.40.6', 'fe80::f816:3eff:fe88:304f', '192.168.50.6', 'fe80::f816:3eff:fe47:42dd', '192.168.10.6', 'fe80::f816:3eff:fe0e:8aed', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f098:e0ff:feda:cc4b', 'fe80::fc16:3eff:fe0b:6e2b', 'fe80::58fc:8ff:fe98:1e95', 'fe80::fc16:3eff:fefb:204b', 'fe80::58e8:72ff:fe3d:6def', 'fe80::fc16:3eff:fea2:1ae1', 'fe80::dc76:ddff:fe40:110a', 'fe80::fc16:3eff:fe40:404e', 'fe80::7480:56ff:fe72:5866'] Jun 03 01:08:43.806573 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 03 01:08:43.806904 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.lightos [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] LIGHTOS: no hostnqn found. {{(pid=98288) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 03 01:08:43.807072 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] <== get_connector_properties: return (67ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.177', 'host': 'np0000002000', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:1f7f54f5dd13', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '83c7f1af-554d-4b1b-8e72-d1c6569161d3', 'nvme_native_multipath': False} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:43.808089 np0000002000 nova-compute[98288]: DEBUG nova.virt.block_device [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Updating existing volume attachment record: 7f21c444-3b1e-498e-8f9a-8f4400e3a2be {{(pid=98288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 03 01:08:43.819147 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bd14601d-8adb-45b4-8297-6b553a695a9a req-a3986a0e-22ce-4152-b4bf-099be204ae15 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Received event network-changed-58bc32a7-25f9-4a71-a78d-4727002c1ed0 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:43.819311 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-bd14601d-8adb-45b4-8297-6b553a695a9a req-a3986a0e-22ce-4152-b4bf-099be204ae15 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing instance network info cache due to event network-changed-58bc32a7-25f9-4a71-a78d-4727002c1ed0. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:43.819552 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bd14601d-8adb-45b4-8297-6b553a695a9a req-a3986a0e-22ce-4152-b4bf-099be204ae15 service nova] Acquiring lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:43.847380 np0000002000 nova-compute[98288]: INFO nova.virt.block_device [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Attempting to driver detach volume 3ff78393-7780-4cb6-b40c-f5246a0aef68 from mountpoint /dev/vdb Jun 03 01:08:43.853531 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Found disk vdb by alias ua-3ff78393-7780-4cb6-b40c-f5246a0aef68 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:08:43.855884 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Found disk vdb by alias ua-3ff78393-7780-4cb6-b40c-f5246a0aef68 {{(pid=98288) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}} Jun 03 01:08:43.856162 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Attempting to detach device vdb from instance 6eefbe1c-468b-4294-9f24-7cc661bb3df2 from the persistent domain config. {{(pid=98288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 03 01:08:43.856391 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] detach device xml: Jun 03 01:08:43.856391 np0000002000 nova-compute[98288]: Jun 03 01:08:43.856391 np0000002000 nova-compute[98288]: Jun 03 01:08:43.856391 np0000002000 nova-compute[98288]: Jun 03 01:08:43.856391 np0000002000 nova-compute[98288]: Jun 03 01:08:43.856391 np0000002000 nova-compute[98288]: 3ff78393-7780-4cb6-b40c-f5246a0aef68 Jun 03 01:08:43.856391 np0000002000 nova-compute[98288]:
Jun 03 01:08:43.856391 np0000002000 nova-compute[98288]: Jun 03 01:08:43.856391 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:08:43.865311 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Successfully detached device vdb from instance 6eefbe1c-468b-4294-9f24-7cc661bb3df2 from the persistent domain config. Jun 03 01:08:43.866030 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] (1/8): Attempting to detach device vdb with device alias ua-3ff78393-7780-4cb6-b40c-f5246a0aef68 from instance 6eefbe1c-468b-4294-9f24-7cc661bb3df2 from the live domain config. {{(pid=98288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}} Jun 03 01:08:43.866030 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] detach device xml: Jun 03 01:08:43.866030 np0000002000 nova-compute[98288]: Jun 03 01:08:43.866030 np0000002000 nova-compute[98288]: Jun 03 01:08:43.866030 np0000002000 nova-compute[98288]: Jun 03 01:08:43.866030 np0000002000 nova-compute[98288]: Jun 03 01:08:43.866030 np0000002000 nova-compute[98288]: 3ff78393-7780-4cb6-b40c-f5246a0aef68 Jun 03 01:08:43.866030 np0000002000 nova-compute[98288]:
Jun 03 01:08:43.866030 np0000002000 nova-compute[98288]: Jun 03 01:08:43.866030 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:08:43.989431 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:08:44.077916 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Object Instance<2ae68109-fd4c-4cb8-ac62-f49800f5ec34> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:08:44.081054 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:44.138505 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Successfully created port: 7fa21f7f-d12f-4b73-b581-0c992a97a8ab {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:08:44.181570 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-d0ebc82f-c855-4516-b4ff-346f1dc33919 req-6d86f97b-2b64-4c0e-b40a-759bfb30ee5d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:44.200719 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Acquiring lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:44.220932 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Creating config drive at /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.config.rescue Jun 03 01:08:44.225557 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwu5xa2c0 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:44.262814 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-d0ebc82f-c855-4516-b4ff-346f1dc33919 req-6d86f97b-2b64-4c0e-b40a-759bfb30ee5d service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:08:44.269638 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2ae68109-fd4c-4cb8-ac62-f49800f5ec34/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwu5xa2c0" returned: 0 in 0.044s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:44.387532 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:08:44.388053 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c', 'iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75b12252-4c73-488f-beaa-23a5c0dd078c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:44.388252 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:44.495316 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:08:44.515420 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Received event ua-3ff78393-7780-4cb6-b40c-f5246a0aef68> from libvirt while the driver is waiting for it; dispatched. {{(pid=98288) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}} Jun 03 01:08:44.518996 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-d0ebc82f-c855-4516-b4ff-346f1dc33919 req-6d86f97b-2b64-4c0e-b40a-759bfb30ee5d service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:44.520223 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3ff78393-7780-4cb6-b40c-f5246a0aef68 for instance 6eefbe1c-468b-4294-9f24-7cc661bb3df2 {{(pid=98288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}} Jun 03 01:08:44.524598 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Successfully detached device vdb from instance 6eefbe1c-468b-4294-9f24-7cc661bb3df2 from the live domain config. Jun 03 01:08:44.529507 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] calling os-brick to detach iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 03 01:08:44.529507 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ff78393-7780-4cb6-b40c-f5246a0aef68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:44.529507 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:44.655013 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98288) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}} Jun 03 01:08:44.655013 np0000002000 nova-compute[98288]: DEBUG nova.compute.provider_tree [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Inventory has not changed in ProviderTree for provider: e5e0d48c-b64b-4e03-864c-efd360069abb {{(pid=98288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 03 01:08:44.717233 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Successfully updated port: 7fa21f7f-d12f-4b73-b581-0c992a97a8ab {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:08:44.915640 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:44.917277 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:44.947160 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:45.021183 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-d0ebc82f-c855-4516-b4ff-346f1dc33919 req-6d86f97b-2b64-4c0e-b40a-759bfb30ee5d service nova] Releasing lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:45.024925 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bd14601d-8adb-45b4-8297-6b553a695a9a req-a3986a0e-22ce-4152-b4bf-099be204ae15 service nova] Acquired lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:45.024925 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-bd14601d-8adb-45b4-8297-6b553a695a9a req-a3986a0e-22ce-4152-b4bf-099be204ae15 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Refreshing network info cache for port 58bc32a7-25f9-4a71-a78d-4727002c1ed0 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:45.031863 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:45.156177 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-3f592532-609f-4c9d-bc13-00c6431ac90a req-58df0cf8-44d4-48e6-8565-443b3efeed7c service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received event network-vif-plugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:45.157414 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-3f592532-609f-4c9d-bc13-00c6431ac90a req-58df0cf8-44d4-48e6-8565-443b3efeed7c service nova] Acquiring lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:45.158565 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-3f592532-609f-4c9d-bc13-00c6431ac90a req-58df0cf8-44d4-48e6-8565-443b3efeed7c service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:45.158798 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-3f592532-609f-4c9d-bc13-00c6431ac90a req-58df0cf8-44d4-48e6-8565-443b3efeed7c service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:45.158963 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-3f592532-609f-4c9d-bc13-00c6431ac90a req-58df0cf8-44d4-48e6-8565-443b3efeed7c service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] No waiting events found dispatching network-vif-plugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:45.159093 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-3f592532-609f-4c9d-bc13-00c6431ac90a req-58df0cf8-44d4-48e6-8565-443b3efeed7c service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received unexpected event network-vif-plugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 for instance with vm_state active and task_state rescuing. Jun 03 01:08:45.160531 np0000002000 nova-compute[98288]: DEBUG nova.scheduler.client.report [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Inventory has not changed for provider e5e0d48c-b64b-4e03-864c-efd360069abb based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 03 01:08:45.222467 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "refresh_cache-f105ef75-cffa-4f4d-a782-a5470dd30f0a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:45.222467 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquired lock "refresh_cache-f105ef75-cffa-4f4d-a782-a5470dd30f0a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:45.222467 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:08:45.288798 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:45.291984 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:45.299236 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:45.300123 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:45.337780 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:45.504778 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:08:45.505768 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:08:45.506005 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Creating image(s) Jun 03 01:08:45.506509 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "/opt/stack/data/nova/instances/f105ef75-cffa-4f4d-a782-a5470dd30f0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:45.506704 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "/opt/stack/data/nova/instances/f105ef75-cffa-4f4d-a782-a5470dd30f0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:45.507119 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "/opt/stack/data/nova/instances/f105ef75-cffa-4f4d-a782-a5470dd30f0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:45.507660 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:45.510615 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:45.511567 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:45.530773 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-bd14601d-8adb-45b4-8297-6b553a695a9a req-a3986a0e-22ce-4152-b4bf-099be204ae15 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:45.600877 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.089s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:45.601894 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:45.603971 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:45.604395 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:45.609237 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:45.609625 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:45.656730 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-bd14601d-8adb-45b4-8297-6b553a695a9a req-a3986a0e-22ce-4152-b4bf-099be204ae15 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:08:45.670030 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.459s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:45.672636 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Start building networks asynchronously for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 03 01:08:45.697082 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.087s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:45.697405 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/f105ef75-cffa-4f4d-a782-a5470dd30f0a/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:45.743526 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Removed pending STOPPED event for 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 due to new event Resumed> {{(pid=98288) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 03 01:08:45.743885 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Resumed> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:45.743885 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] VM Resumed (Lifecycle Event) Jun 03 01:08:45.750169 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-1eecb31c-3a62-4192-b7e6-f0c5abeb81b8 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:45.760617 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/f105ef75-cffa-4f4d-a782-a5470dd30f0a/disk 1073741824" returned: 0 in 0.063s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:45.760947 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.157s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:45.761211 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:45.845821 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-bd14601d-8adb-45b4-8297-6b553a695a9a req-a3986a0e-22ce-4152-b4bf-099be204ae15 service nova] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:45.849185 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:08:45.863453 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.102s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:45.866887 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f105ef75-cffa-4f4d-a782-a5470dd30f0a/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:08:45.867914 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f105ef75-cffa-4f4d-a782-a5470dd30f0a/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:45.902594 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8a44b64e-ab75-41d2-a8b0-5a8817fa2152 req-1dbfac57-f2dc-4d99-800f-5d49cf88ec5f service nova] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Received event network-changed-7fa21f7f-d12f-4b73-b581-0c992a97a8ab {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:45.906402 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-8a44b64e-ab75-41d2-a8b0-5a8817fa2152 req-1dbfac57-f2dc-4d99-800f-5d49cf88ec5f service nova] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Refreshing instance network info cache due to event network-changed-7fa21f7f-d12f-4b73-b581-0c992a97a8ab. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:45.907702 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8a44b64e-ab75-41d2-a8b0-5a8817fa2152 req-1dbfac57-f2dc-4d99-800f-5d49cf88ec5f service nova] Acquiring lock "refresh_cache-f105ef75-cffa-4f4d-a782-a5470dd30f0a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:45.960431 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f105ef75-cffa-4f4d-a782-a5470dd30f0a/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:45.960822 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Cannot resize image /opt/stack/data/nova/instances/f105ef75-cffa-4f4d-a782-a5470dd30f0a/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:08:45.961112 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:08:45.961413 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Ensure instance console log exists: /opt/stack/data/nova/instances/f105ef75-cffa-4f4d-a782-a5470dd30f0a/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:08:45.961538 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:45.962496 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:45.962496 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:46.030725 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:46.150317 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Updating instance_info_cache with network_info: [{"id": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "address": "fa:16:3e:3b:a4:bc", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa21f7f-d1", "ovs_interfaceid": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:46.181068 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Allocating IP information in the background. {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 03 01:08:46.181503 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] allocate_for_instance() {{(pid=98288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 03 01:08:46.185467 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:46.185467 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:46.249983 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:46.254676 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:08:46.269923 np0000002000 nova-compute[98288]: DEBUG nova.policy [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4586ad9e4c304b0fa9a960267667ac64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e01380196548bbbe8f5f9e9147494b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98288) authorize /opt/stack/nova/nova/policy.py:192}} Jun 03 01:08:46.352483 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-bd14601d-8adb-45b4-8297-6b553a695a9a req-a3986a0e-22ce-4152-b4bf-099be204ae15 service nova] Releasing lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:46.354325 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Acquired lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:46.354539 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:08:46.654585 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Releasing lock "refresh_cache-f105ef75-cffa-4f4d-a782-a5470dd30f0a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:46.654585 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Instance network_info: |[{"id": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "address": "fa:16:3e:3b:a4:bc", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa21f7f-d1", "ovs_interfaceid": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:08:46.655608 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Start _get_guest_xml network_info=[{"id": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "address": "fa:16:3e:3b:a4:bc", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa21f7f-d1", "ovs_interfaceid": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:08:46.656129 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8a44b64e-ab75-41d2-a8b0-5a8817fa2152 req-1dbfac57-f2dc-4d99-800f-5d49cf88ec5f service nova] Acquired lock "refresh_cache-f105ef75-cffa-4f4d-a782-a5470dd30f0a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:46.657249 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.268s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:46.658079 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-8a44b64e-ab75-41d2-a8b0-5a8817fa2152 req-1dbfac57-f2dc-4d99-800f-5d49cf88ec5f service nova] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Refreshing network info cache for port 7fa21f7f-d12f-4b73-b581-0c992a97a8ab {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:46.662618 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c', 'iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75b12252-4c73-488f-beaa-23a5c0dd078c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:08:46.664710 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:08:46.668688 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='f105ef75-cffa-4f4d-a782-a5470dd30f0a'), owner=OwnerMeta(userid='78fb92b522cd485b9d2ea55fa096b4b2', username='tempest-AttachVolumeMultiAttachTest-619856118-project-member', projectid='ac66984846344d438d4d4208f858a38b', projectname='tempest-AttachVolumeMultiAttachTest-619856118'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "address": "fa:16:3e:3b:a4:bc", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa21f7f-d1", "ovs_interfaceid": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448926.6657877) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:08:46.668688 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:08:46.668688 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:08:46.669029 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:08:46.669029 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:08:46.672793 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:08:46.672793 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:08:46.672793 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:08:46.672793 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:08:46.672793 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:08:46.672793 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:08:46.672793 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:08:46.672793 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:08:46.672793 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:08:46.672793 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:08:46.672793 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:08:46.672793 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:08:46.684542 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 03 01:08:46.693846 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:46.696502 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:46.696696 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:08:46.699119 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:46.704066 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:46.704946 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='multiattach-server-0',id=24,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAePfJRFE5MbB73svpmh6/slP6My+clrD6IsZktuPU4kX8bVvxtC+BwXHLautWXFjNU5vVHBtkPBIXE352FOun1A6jZ7ecWyrQaqqRCrZmhx8VCXKxPAhe3IH5xaIf2Arw==',key_name='tempest-keypair-670466371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac66984846344d438d4d4208f858a38b',ramdisk_id='',reservation_id='r-a9ksof1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-619856118',owner_user_name='tempest-AttachVolumeMultiAttachTest-619856118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78fb92b522cd485b9d2ea55fa096b4b2',uuid=f105ef75-cffa-4f4d-a782-a5470dd30f0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "address": "fa:16:3e:3b:a4:bc", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa21f7f-d1", "ovs_interfaceid": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:08:46.705253 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:08:46.705601 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Converting VIF {"id": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "address": "fa:16:3e:3b:a4:bc", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa21f7f-d1", "ovs_interfaceid": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:46.706674 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a4:bc,bridge_name='br-int',has_traffic_filtering=True,id=7fa21f7f-d12f-4b73-b581-0c992a97a8ab,network=Network(b926d00a-7715-4063-bc45-4da20af659f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa21f7f-d1') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:46.707491 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lazy-loading 'pci_devices' on Instance uuid f105ef75-cffa-4f4d-a782-a5470dd30f0a {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:46.716114 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:08:46.716114 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:46.723115 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:08:46.723115 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:46.734541 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c] added Jun 03 01:08:46.734541 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:08:46.734541 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:46.734541 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:46.734541 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:46.734541 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:46.734541 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:46.734779 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:08:46.735060 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0383(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:08:46.735347 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:08:46.736653 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c] added Jun 03 01:08:46.736653 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:08:46.736653 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:46.736653 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:46.736653 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:46.736653 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:46.736653 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:46.736805 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:08:46.737095 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:08:46.737095 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:08:46.761742 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:46.761742 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] VM Started (Lifecycle Event) Jun 03 01:08:46.808558 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Successfully created port: 9b52384d-693c-4b57-b5c0-491e9330f342 {{(pid=98288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 03 01:08:47.065317 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-6ca87bc1-73e9-404e-a5a5-96a596ee4726 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Unrescuing Jun 03 01:08:47.065515 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-6ca87bc1-73e9-404e-a5a5-96a596ee4726 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquiring lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:47.065574 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-6ca87bc1-73e9-404e-a5a5-96a596ee4726 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Acquired lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:47.065679 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-6ca87bc1-73e9-404e-a5a5-96a596ee4726 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:08:47.163836 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-8a44b64e-ab75-41d2-a8b0-5a8817fa2152 req-1dbfac57-f2dc-4d99-800f-5d49cf88ec5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:47.202735 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Start building block device mappings for instance. {{(pid=98288) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] End _get_guest_xml xml= Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: f105ef75-cffa-4f4d-a782-a5470dd30f0a Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: instance-00000018 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: 196608 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: multiattach-server-0 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: 2026-06-03 01:08:46 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: 192 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: True Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: bare Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: tempest-AttachVolumeMultiAttachTest-619856118-project-member Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: tempest-AttachVolumeMultiAttachTest-619856118 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: f105ef75-cffa-4f4d-a782-a5470dd30f0a Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: f105ef75-cffa-4f4d-a782-a5470dd30f0a Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: hvm Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: 128 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: Jun 03 01:08:47.215309 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:08:47.218099 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Preparing to wait for external event network-vif-plugged-7fa21f7f-d12f-4b73-b581-0c992a97a8ab {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:08:47.218099 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Acquiring lock "f105ef75-cffa-4f4d-a782-a5470dd30f0a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:47.218099 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "f105ef75-cffa-4f4d-a782-a5470dd30f0a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:47.218099 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Lock "f105ef75-cffa-4f4d-a782-a5470dd30f0a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:47.218099 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='multiattach-server-0',id=24,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAePfJRFE5MbB73svpmh6/slP6My+clrD6IsZktuPU4kX8bVvxtC+BwXHLautWXFjNU5vVHBtkPBIXE352FOun1A6jZ7ecWyrQaqqRCrZmhx8VCXKxPAhe3IH5xaIf2Arw==',key_name='tempest-keypair-670466371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac66984846344d438d4d4208f858a38b',ramdisk_id='',reservation_id='r-a9ksof1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-619856118',owner_user_name='tempest-AttachVolumeMultiAttachTest-619856118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78fb92b522cd485b9d2ea55fa096b4b2',uuid=f105ef75-cffa-4f4d-a782-a5470dd30f0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "address": "fa:16:3e:3b:a4:bc", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa21f7f-d1", "ovs_interfaceid": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:08:47.218099 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Converting VIF {"id": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "address": "fa:16:3e:3b:a4:bc", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa21f7f-d1", "ovs_interfaceid": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:47.218099 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a4:bc,bridge_name='br-int',has_traffic_filtering=True,id=7fa21f7f-d12f-4b73-b581-0c992a97a8ab,network=Network(b926d00a-7715-4063-bc45-4da20af659f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa21f7f-d1') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:47.218099 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a4:bc,bridge_name='br-int',has_traffic_filtering=True,id=7fa21f7f-d12f-4b73-b581-0c992a97a8ab,network=Network(b926d00a-7715-4063-bc45-4da20af659f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa21f7f-d1') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:08:47.218099 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:47.219553 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:47.219553 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:08:47.219553 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:47.219553 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b5bfa75-daef-5b04-9568-eb763a91dfca', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:47.221507 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:47.221507 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:47.223430 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:47.223538 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fa21f7f-d1, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:47.223857 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7fa21f7f-d1, col_values=(('qos', UUID('70f20b87-9094-45c8-bd45-6b9edfec9ff8')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:47.224015 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7fa21f7f-d1, col_values=(('external_ids', {'iface-id': '7fa21f7f-d12f-4b73-b581-0c992a97a8ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:a4:bc', 'vm-uuid': 'f105ef75-cffa-4f4d-a782-a5470dd30f0a'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:47.226220 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:47.227512 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:47.232083 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:47.232950 np0000002000 nova-compute[98288]: INFO os_vif [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:a4:bc,bridge_name='br-int',has_traffic_filtering=True,id=7fa21f7f-d12f-4b73-b581-0c992a97a8ab,network=Network(b926d00a-7715-4063-bc45-4da20af659f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa21f7f-d1') Jun 03 01:08:47.251778 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fff19efe-65ec-4a08-bdd9-9de669206a96 req-8e7a15b5-955f-4d90-b72b-d9d018ad9ad3 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received event network-vif-plugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:47.251972 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fff19efe-65ec-4a08-bdd9-9de669206a96 req-8e7a15b5-955f-4d90-b72b-d9d018ad9ad3 service nova] Acquiring lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:47.252130 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fff19efe-65ec-4a08-bdd9-9de669206a96 req-8e7a15b5-955f-4d90-b72b-d9d018ad9ad3 service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:47.252231 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-fff19efe-65ec-4a08-bdd9-9de669206a96 req-8e7a15b5-955f-4d90-b72b-d9d018ad9ad3 service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:47.252353 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-fff19efe-65ec-4a08-bdd9-9de669206a96 req-8e7a15b5-955f-4d90-b72b-d9d018ad9ad3 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] No waiting events found dispatching network-vif-plugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:47.252565 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-fff19efe-65ec-4a08-bdd9-9de669206a96 req-8e7a15b5-955f-4d90-b72b-d9d018ad9ad3 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received unexpected event network-vif-plugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 for instance with vm_state rescued and task_state unrescuing. Jun 03 01:08:47.265331 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:47.268605 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:08:47.290674 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:08:47.524063 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Successfully updated port: 9b52384d-693c-4b57-b5c0-491e9330f342 {{(pid=98288) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 03 01:08:47.546216 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.002891171000101167 future=) was cancelled during its delay period, skipping {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:47.546464 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:47.546825 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.7226074480001898 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:47.547459 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.7223822690000361 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:47.568998 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-6ca87bc1-73e9-404e-a5a5-96a596ee4726 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:47.580700 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-ccc73ea6-f5f0-4a24-9b75-a54e0797743b req-51d6c9a7-945d-4c02-9ce8-7b60d0fd0761 service nova] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Received event network-changed-9b52384d-693c-4b57-b5c0-491e9330f342 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:47.580762 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-ccc73ea6-f5f0-4a24-9b75-a54e0797743b req-51d6c9a7-945d-4c02-9ce8-7b60d0fd0761 service nova] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Refreshing instance network info cache due to event network-changed-9b52384d-693c-4b57-b5c0-491e9330f342. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:47.580894 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ccc73ea6-f5f0-4a24-9b75-a54e0797743b req-51d6c9a7-945d-4c02-9ce8-7b60d0fd0761 service nova] Acquiring lock "refresh_cache-9b3ac820-6802-4d93-abe4-e6f8ad2d7f55" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:47.580992 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ccc73ea6-f5f0-4a24-9b75-a54e0797743b req-51d6c9a7-945d-4c02-9ce8-7b60d0fd0761 service nova] Acquired lock "refresh_cache-9b3ac820-6802-4d93-abe4-e6f8ad2d7f55" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:47.581096 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-ccc73ea6-f5f0-4a24-9b75-a54e0797743b req-51d6c9a7-945d-4c02-9ce8-7b60d0fd0761 service nova] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Refreshing network info cache for port 9b52384d-693c-4b57-b5c0-491e9330f342 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:47.686108 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:47.735925 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:08:47.737522 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:08:47.751875 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:08:47.760797 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:47.772313 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 03 01:08:47.774106 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:47.782780 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:47.794369 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-8a44b64e-ab75-41d2-a8b0-5a8817fa2152 req-1dbfac57-f2dc-4d99-800f-5d49cf88ec5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:47.797939 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.797939 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.797939 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.797939 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.797939 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.797939 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.797939 np0000002000 nova-compute[98288]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.797939 np0000002000 nova-compute[98288]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.797939 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:47.798836 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.798836 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.798836 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.798836 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.798836 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.798836 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.798836 np0000002000 nova-compute[98288]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.798836 np0000002000 nova-compute[98288]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.798836 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:47.806156 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.806156 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.806156 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.806156 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.806156 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.806156 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.806156 np0000002000 nova-compute[98288]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.806156 np0000002000 nova-compute[98288]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.806156 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:47.807731 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.807731 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.807731 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.807731 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.807731 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.807731 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.807731 np0000002000 nova-compute[98288]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.807731 np0000002000 nova-compute[98288]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.807731 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:47.857333 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c, portal: 192.168.40.100,3260] Jun 03 01:08:47.857333 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c, portal: 192.168.40.100,3260] successful. Jun 03 01:08:47.857333 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:47.870466 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c, portal: 192.168.50.100,3260] Jun 03 01:08:47.870466 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c, portal: 192.168.50.100,3260] successful. Jun 03 01:08:47.870466 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:47.874782 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:47.882510 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:47.897598 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.897598 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.897598 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.897598 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.897598 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.897598 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.897598 np0000002000 nova-compute[98288]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.897598 np0000002000 nova-compute[98288]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.897598 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:47.897598 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:47.897598 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:47.898083 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.898083 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.898083 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.898083 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.898083 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.898083 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.898083 np0000002000 nova-compute[98288]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.898083 np0000002000 nova-compute[98288]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.898083 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:47.898083 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:47.898083 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:47.898659 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:47.898659 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:08:47.899676 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] HCTL ('15', '-', '-', 0) found on session 48 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:08:47.899817 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:47.903855 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:47.905479 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:47.905593 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:08:47.906835 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] HCTL ('16', '-', '-', 0) found on session 49 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:08:47.906835 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:08:47.921543 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Searching for a device in session 48 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:08:47.921543 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75b12252-4c73-488f-beaa-23a5c0dd078c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:08:47.936201 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Searching for a device in session 49 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:08:47.936201 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '75b12252-4c73-488f-beaa-23a5c0dd078c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:08:47.963755 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received event network-changed-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:47.963948 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Refreshing instance network info cache due to event network-changed-49f6412d-4366-42e3-a2f7-19a20cc8c032. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:47.964062 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] Acquiring lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:48.011340 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:48.017983 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-6ca87bc1-73e9-404e-a5a5-96a596ee4726 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:48.029798 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "refresh_cache-9b3ac820-6802-4d93-abe4-e6f8ad2d7f55" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:48.048796 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-8a44b64e-ab75-41d2-a8b0-5a8817fa2152 req-1dbfac57-f2dc-4d99-800f-5d49cf88ec5f service nova] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Updated VIF entry in instance network info cache for port 7fa21f7f-d12f-4b73-b581-0c992a97a8ab. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:08:48.049118 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-8a44b64e-ab75-41d2-a8b0-5a8817fa2152 req-1dbfac57-f2dc-4d99-800f-5d49cf88ec5f service nova] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Updating instance_info_cache with network_info: [{"id": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "address": "fa:16:3e:3b:a4:bc", "network": {"id": "b926d00a-7715-4063-bc45-4da20af659f4", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-254342674-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ac66984846344d438d4d4208f858a38b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa21f7f-d1", "ovs_interfaceid": "7fa21f7f-d12f-4b73-b581-0c992a97a8ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:48.102417 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-ccc73ea6-f5f0-4a24-9b75-a54e0797743b req-51d6c9a7-945d-4c02-9ce8-7b60d0fd0761 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:48.114983 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:48.207383 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-ccc73ea6-f5f0-4a24-9b75-a54e0797743b req-51d6c9a7-945d-4c02-9ce8-7b60d0fd0761 service nova] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:08:48.217829 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Start spawning the instance on the hypervisor. {{(pid=98288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 03 01:08:48.218656 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Creating instance directory {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}} Jun 03 01:08:48.218866 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Creating image(s) Jun 03 01:08:48.219243 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b3ac820-6802-4d93-abe4-e6f8ad2d7f55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:48.219399 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "/opt/stack/data/nova/instances/9b3ac820-6802-4d93-abe4-e6f8ad2d7f55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:48.219821 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "/opt/stack/data/nova/instances/9b3ac820-6802-4d93-abe4-e6f8ad2d7f55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:48.220339 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:48.222814 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:48.223749 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:48.255689 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-6ca87bc1-73e9-404e-a5a5-96a596ee4726 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Updating instance_info_cache with network_info: [{"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:48.271937 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.002471742999887283 future=) submitted to {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:48.276579 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Emitting event Stopped> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:48.277133 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:48.277691 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] VM Stopped (Lifecycle Event) Jun 03 01:08:48.318768 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.095s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:48.319368 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:48.319892 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:48.320530 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:48.325927 np0000002000 nova-compute[98288]: DEBUG oslo_utils.imageutils.format_inspector [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98288) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 03 01:08:48.326336 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:48.412542 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.086s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:48.412983 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/9b3ac820-6802-4d93-abe4-e6f8ad2d7f55/disk 1073741824 {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:48.430062 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-ccc73ea6-f5f0-4a24-9b75-a54e0797743b req-51d6c9a7-945d-4c02-9ce8-7b60d0fd0761 service nova] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Updating instance_info_cache with network_info: [] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:48.463560 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7,backing_fmt=raw /opt/stack/data/nova/instances/9b3ac820-6802-4d93-abe4-e6f8ad2d7f55/disk 1073741824" returned: 0 in 0.050s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:48.463973 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "a8df227d55f41a71bea9e02d06bfc4327e1a49d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.144s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:48.464251 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:48.517196 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:48.543826 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8df227d55f41a71bea9e02d06bfc4327e1a49d7 --force-share --output=json" returned: 0 in 0.079s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:48.544504 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b3ac820-6802-4d93-abe4-e6f8ad2d7f55/disk. size=1073741824 {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 03 01:08:48.544856 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3ac820-6802-4d93-abe4-e6f8ad2d7f55/disk --force-share --output=json {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:48.560830 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-8a44b64e-ab75-41d2-a8b0-5a8817fa2152 req-1dbfac57-f2dc-4d99-800f-5d49cf88ec5f service nova] Releasing lock "refresh_cache-f105ef75-cffa-4f4d-a782-a5470dd30f0a" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:48.627083 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b3ac820-6802-4d93-abe4-e6f8ad2d7f55/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:48.627483 np0000002000 nova-compute[98288]: DEBUG nova.virt.disk.api [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Cannot resize image /opt/stack/data/nova/instances/9b3ac820-6802-4d93-abe4-e6f8ad2d7f55/disk to a smaller size. {{(pid=98288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 03 01:08:48.627787 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Created local disks {{(pid=98288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}} Jun 03 01:08:48.627936 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Ensure instance console log exists: /opt/stack/data/nova/instances/9b3ac820-6802-4d93-abe4-e6f8ad2d7f55/console.log {{(pid=98288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}} Jun 03 01:08:48.628175 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:48.628382 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:48.628598 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:48.703606 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:08:48.761259 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-6ca87bc1-73e9-404e-a5a5-96a596ee4726 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Releasing lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:48.762103 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-6ca87bc1-73e9-404e-a5a5-96a596ee4726 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lazy-loading 'flavor' on Instance uuid 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:48.764040 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] Acquired lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:48.764301 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Refreshing network info cache for port 49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:48.773358 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:48.773579 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:48.773579 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] No VIF found with MAC fa:16:3e:3b:a4:bc, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:08:48.774290 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Using config drive Jun 03 01:08:48.781679 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: d6d00dfe-5dd2-467e-8b1a-e6bab7bfc1aa] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:48.805641 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:48.934645 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-ccc73ea6-f5f0-4a24-9b75-a54e0797743b req-51d6c9a7-945d-4c02-9ce8-7b60d0fd0761 service nova] Releasing lock "refresh_cache-9b3ac820-6802-4d93-abe4-e6f8ad2d7f55" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:48.935123 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquired lock "refresh_cache-9b3ac820-6802-4d93-abe4-e6f8ad2d7f55" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:48.935304 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Building network info cache for instance {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 03 01:08:49.115043 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:49.271915 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:49.281192 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:49.306133 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:49.308321 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:49.334163 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:49.335906 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:49.359170 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:49.367334 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:49.468687 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:49.501964 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Creating config drive at /opt/stack/data/nova/instances/f105ef75-cffa-4f4d-a782-a5470dd30f0a/disk.config Jun 03 01:08:49.506353 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f105ef75-cffa-4f4d-a782-a5470dd30f0a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpea5nfum_ {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 03 01:08:49.559162 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.processutils [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f105ef75-cffa-4f4d-a782-a5470dd30f0a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpea5nfum_" returned: 0 in 0.052s {{(pid=98288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 03 01:08:49.566026 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eaf0aba8-a6b4-47c3-9cba-577148f580c5 req-dcaa3678-8a02-4c01-ac3f-1c4ee5109459 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received event network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:49.566265 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eaf0aba8-a6b4-47c3-9cba-577148f580c5 req-dcaa3678-8a02-4c01-ac3f-1c4ee5109459 service nova] Acquiring lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:49.566453 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eaf0aba8-a6b4-47c3-9cba-577148f580c5 req-dcaa3678-8a02-4c01-ac3f-1c4ee5109459 service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:49.566578 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-eaf0aba8-a6b4-47c3-9cba-577148f580c5 req-dcaa3678-8a02-4c01-ac3f-1c4ee5109459 service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:49.566696 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-eaf0aba8-a6b4-47c3-9cba-577148f580c5 req-dcaa3678-8a02-4c01-ac3f-1c4ee5109459 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] No waiting events found dispatching network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:49.566814 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-eaf0aba8-a6b4-47c3-9cba-577148f580c5 req-dcaa3678-8a02-4c01-ac3f-1c4ee5109459 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received unexpected event network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 for instance with vm_state rescued and task_state unrescuing. Jun 03 01:08:49.572642 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Instance cache missing network info. {{(pid=98288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 03 01:08:49.588112 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:49.635462 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:49.714685 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:49.726588 np0000002000 nova-compute[98288]: DEBUG nova.utils [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Queued Task(fn=>, remaining_delay=14.999558818999958 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:49.728936 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Found WWN 330000000fbf08fe9 for multipath device dm-6 {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 03 01:08:49.729245 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.073s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:49.729428 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] <== connect_volume: return (5340ms) {'type': 'block', 'scsi_wwn': '330000000fbf08fe9', 'path': '/dev/dm-6', 'multipath_id': '330000000fbf08fe9'} {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:49.729585 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fbf08fe9', 'path': '/dev/dm-6', 'multipath_id': '330000000fbf08fe9'} {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 03 01:08:49.730668 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.995459973999914 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:49.730668 np0000002000 nova-compute[98288]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.995286167999893 future=) {{(pid=98288) _log /opt/stack/nova/nova/utils.py:1508}} Jun 03 01:08:49.731619 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.202s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:49.732067 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ff78393-7780-4cb6-b40c-f5246a0aef68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 03 01:08:49.732252 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', 0)] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 03 01:08:49.734256 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Instance destroyed successfully. Jun 03 01:08:49.735997 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] Lazy-loading 'flavor' on Instance uuid 731d6dce-0633-4f07-98af-b6da39e18417 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:49.739488 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-6ca87bc1-73e9-404e-a5a5-96a596ee4726 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Lazy-loading 'numa_topology' on Instance uuid 2ae68109-fd4c-4cb8-ac62-f49800f5ec34 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:49.773355 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:49.773355 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:49.773355 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:49.773355 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:49.773355 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:49.773355 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:49.773355 np0000002000 nova-compute[98288]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:49.773355 np0000002000 nova-compute[98288]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:49.773355 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:49.773355 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:49.773355 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:49.773873 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:49.773873 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:49.773873 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:49.773873 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:49.773873 np0000002000 nova-compute[98288]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:49.773873 np0000002000 nova-compute[98288]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68 (non-flash) Jun 03 01:08:49.773873 np0000002000 nova-compute[98288]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:49.773873 np0000002000 nova-compute[98288]: tcp: [47] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a (non-flash) Jun 03 01:08:49.773873 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:49.773873 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:49.773873 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:49.773873 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5', '42'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a', '46'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d024b590-d1d4-4303-8abd-9f5b7aca875a', '47'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c', '49')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 03 01:08:49.774209 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', '44')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:08:49.778921 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68', '45')] {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 03 01:08:49.780024 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Resulting device map defaultdict(. at 0x73e7b0162b60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68'): ({'sdg'}, set())}) {{(pid=98288) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 03 01:08:49.780275 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Removing multipathed devices sdf, sdg {{(pid=98288) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 03 01:08:49.780566 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Flush multipath device 3300000008ef74a8a {{(pid=98288) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 03 01:08:49.810013 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:08:49.854411 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:49.860461 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98288) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 03 01:08:49.892161 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Updated VIF entry in instance network info cache for port 49f6412d-4366-42e3-a2f7-19a20cc8c032. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:08:49.892515 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Updating instance_info_cache with network_info: [{"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:49.899402 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 03 01:08:49.899563 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 03 01:08:49.901733 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 03 01:08:49.919145 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98288) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 03 01:08:49.919460 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68')] {{(pid=98288) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 03 01:08:49.933140 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:49.943969 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:49.974606 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68, portal: 192.168.40.100,3260] Jun 03 01:08:49.974606 np0000002000 nova-compute[98288]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68, portal: 192.168.40.100,3260] successful. Jun 03 01:08:49.974606 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:50.002269 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.008860 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:50.018536 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.027773 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:50.056003 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.066258 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68, portal: 192.168.50.100,3260] Jun 03 01:08:50.066258 np0000002000 nova-compute[98288]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-3ff78393-7780-4cb6-b40c-f5246a0aef68, portal: 192.168.50.100,3260] successful. Jun 03 01:08:50.066258 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:50.074940 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Updating instance_info_cache with network_info: [{"id": "9b52384d-693c-4b57-b5c0-491e9330f342", "address": "fa:16:3e:65:02:8d", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b52384d-69", "ovs_interfaceid": "9b52384d-693c-4b57-b5c0-491e9330f342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:50.097406 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:50.097406 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:50.097406 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] <== disconnect_volume: return (5566ms) None {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 03 01:08:50.097406 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] [instance: 6eefbe1c-468b-4294-9f24-7cc661bb3df2] Disconnected iSCSI Volume {{(pid=98288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 03 01:08:50.130893 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.134395 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.141073 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Updating instance_info_cache with network_info: [{"id": "8c74fc9e-d0c3-4b2a-ba57-ec57f90176dd", "address": "fa:16:3e:14:c0:33", "network": {"id": "97df5886-6ee8-4735-9015-26059b0f0a2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-881377593-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c74fc9e-d0", "ovs_interfaceid": "8c74fc9e-d0c3-4b2a-ba57-ec57f90176dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddd8215e-3724-44f6-be74-72c71a64db34", "address": "fa:16:3e:ad:aa:5b", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd8215e-37", "ovs_interfaceid": "ddd8215e-3724-44f6-be74-72c71a64db34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "526f62a9-7cd1-4340-8c1a-7c97514555c3", "address": "fa:16:3e:9e:2d:14", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap526f62a9-7c", "ovs_interfaceid": "526f62a9-7cd1-4340-8c1a-7c97514555c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "123df424-6ed2-46af-8841-b8913863bbff", "address": "fa:16:3e:c6:57:28", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123df424-6e", "ovs_interfaceid": "123df424-6ed2-46af-8841-b8913863bbff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d87a756b-eaae-4f37-8617-80e0bde7e645", "address": "fa:16:3e:e6:74:c2", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87a756b-ea", "ovs_interfaceid": "d87a756b-eaae-4f37-8617-80e0bde7e645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e07149b8-1bb8-4152-8a93-34bac5a39f44", "address": "fa:16:3e:22:ae:4e", "network": {"id": "4242a6b4-eb6b-4570-9a62-940f827d326d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388153480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape07149b8-1b", "ovs_interfaceid": "e07149b8-1bb8-4152-8a93-34bac5a39f44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58bc32a7-25f9-4a71-a78d-4727002c1ed0", "address": "fa:16:3e:cc:67:43", "network": {"id": "4242a6b4-eb6b-4570-9a62-940f827d326d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388153480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bc32a7-25", "ovs_interfaceid": "58bc32a7-25f9-4a71-a78d-4727002c1ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:50.167081 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.240159 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] [instance: 731d6dce-0633-4f07-98af-b6da39e18417] Attempting to attach volume 75b12252-4c73-488f-beaa-23a5c0dd078c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98288) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}} Jun 03 01:08:50.243152 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] attach device xml: Jun 03 01:08:50.243152 np0000002000 nova-compute[98288]: Jun 03 01:08:50.243152 np0000002000 nova-compute[98288]: Jun 03 01:08:50.243152 np0000002000 nova-compute[98288]: Jun 03 01:08:50.243152 np0000002000 nova-compute[98288]: Jun 03 01:08:50.243152 np0000002000 nova-compute[98288]: 75b12252-4c73-488f-beaa-23a5c0dd078c Jun 03 01:08:50.243152 np0000002000 nova-compute[98288]: Jun 03 01:08:50.243152 np0000002000 nova-compute[98288]: {{(pid=98288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 03 01:08:50.243897 np0000002000 nova-compute[98288]: DEBUG nova.objects.base [None req-6ca87bc1-73e9-404e-a5a5-96a596ee4726 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] Object Instance<2ae68109-fd4c-4cb8-ac62-f49800f5ec34> lazy-loaded attributes: flavor,numa_topology {{(pid=98288) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 03 01:08:50.250872 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.255404 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.279050 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.286622 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.384011 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-43dd6f3a-c9c2-4f7d-a3f0-285816631f97 req-fe6faf7e-8a56-4c61-9e34-92c2f17948d3 service nova] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Received event network-vif-plugged-7fa21f7f-d12f-4b73-b581-0c992a97a8ab {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:50.384162 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-43dd6f3a-c9c2-4f7d-a3f0-285816631f97 req-fe6faf7e-8a56-4c61-9e34-92c2f17948d3 service nova] Acquiring lock "f105ef75-cffa-4f4d-a782-a5470dd30f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:50.384466 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-43dd6f3a-c9c2-4f7d-a3f0-285816631f97 req-fe6faf7e-8a56-4c61-9e34-92c2f17948d3 service nova] Lock "f105ef75-cffa-4f4d-a782-a5470dd30f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:50.384520 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-43dd6f3a-c9c2-4f7d-a3f0-285816631f97 req-fe6faf7e-8a56-4c61-9e34-92c2f17948d3 service nova] Lock "f105ef75-cffa-4f4d-a782-a5470dd30f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:50.384664 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-43dd6f3a-c9c2-4f7d-a3f0-285816631f97 req-fe6faf7e-8a56-4c61-9e34-92c2f17948d3 service nova] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Processing event network-vif-plugged-7fa21f7f-d12f-4b73-b581-0c992a97a8ab {{(pid=98288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 03 01:08:50.396164 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] Releasing lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:50.396395 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received event network-changed-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:50.396540 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Refreshing instance network info cache due to event network-changed-49f6412d-4366-42e3-a2f7-19a20cc8c032. {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 03 01:08:50.396694 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] Acquiring lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 03 01:08:50.396785 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] Acquired lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 03 01:08:50.396906 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Refreshing network info cache for port 49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 03 01:08:50.494028 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.501121 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.577179 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Releasing lock "refresh_cache-9b3ac820-6802-4d93-abe4-e6f8ad2d7f55" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:50.577548 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Instance network_info: |[{"id": "9b52384d-693c-4b57-b5c0-491e9330f342", "address": "fa:16:3e:65:02:8d", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b52384d-69", "ovs_interfaceid": "9b52384d-693c-4b57-b5c0-491e9330f342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:08:50.580001 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Start _get_guest_xml network_info=[{"id": "9b52384d-693c-4b57-b5c0-491e9330f342", "address": "fa:16:3e:65:02:8d", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b52384d-69", "ovs_interfaceid": "9b52384d-693c-4b57-b5c0-491e9330f342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'encrypted': False, 'guest_format': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '19d2b67c-d393-46ed-9253-ee20621e0ff0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:08:50.584753 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:08:50.586289 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-366584080', uuid='9b3ac820-6802-4d93-abe4-e6f8ad2d7f55'), owner=OwnerMeta(userid='4586ad9e4c304b0fa9a960267667ac64', username='tempest-AttachVolumeNegativeTest-1145310491-project-member', projectid='88e01380196548bbbe8f5f9e9147494b', projectname='tempest-AttachVolumeNegativeTest-1145310491'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9b52384d-693c-4b57-b5c0-491e9330f342", "address": "fa:16:3e:65:02:8d", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b52384d-69", "ovs_interfaceid": "9b52384d-693c-4b57-b5c0-491e9330f342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448930.5858653) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:08:50.587484 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:08:50.587917 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:08:50.588869 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:08:50.589080 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:08:50.590230 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:08:50.590686 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:08:50.590802 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:08:50.590941 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:08:50.591100 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:08:50.591240 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:08:50.591406 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:08:50.591636 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:08:50.591775 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:08:50.591928 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:08:50.592108 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:08:50.592279 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:08:50.614579 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:08:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-366584080',display_name='tempest-AttachVolumeNegativeTest-server-366584080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-attachvolumenegativetest-server-366584080',id=25,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTrhBORLalF0nS+++pzi3GBYihYPxGyuB0T7CV6sTY9pgP8RUyZoz8vWEagn2Ub2QFSgwDbdhHLFgeUfSp9kQBR5gMr+eT9cuHcxUXJ18rc/RXoc1rLco2kITRyvnXX7g==',key_name='tempest-keypair-85402758',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e01380196548bbbe8f5f9e9147494b',ramdisk_id='',reservation_id='r-uiab0ptf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1145310491',owner_user_name='tempest-AttachVolumeNegativeTest-1145310491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:08:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4586ad9e4c304b0fa9a960267667ac64',uuid=9b3ac820-6802-4d93-abe4-e6f8ad2d7f55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b52384d-693c-4b57-b5c0-491e9330f342", "address": "fa:16:3e:65:02:8d", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b52384d-69", "ovs_interfaceid": "9b52384d-693c-4b57-b5c0-491e9330f342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:08:50.614824 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converting VIF {"id": "9b52384d-693c-4b57-b5c0-491e9330f342", "address": "fa:16:3e:65:02:8d", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b52384d-69", "ovs_interfaceid": "9b52384d-693c-4b57-b5c0-491e9330f342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:50.615561 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:02:8d,bridge_name='br-int',has_traffic_filtering=True,id=9b52384d-693c-4b57-b5c0-491e9330f342,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b52384d-69') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:50.616333 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:50.651049 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Releasing lock "refresh_cache-c861dfe4-7a78-4098-aa35-8d1f948edb4d" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:50.653845 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Instance network_info: |[{"id": "8c74fc9e-d0c3-4b2a-ba57-ec57f90176dd", "address": "fa:16:3e:14:c0:33", "network": {"id": "97df5886-6ee8-4735-9015-26059b0f0a2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-881377593-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c74fc9e-d0", "ovs_interfaceid": "8c74fc9e-d0c3-4b2a-ba57-ec57f90176dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddd8215e-3724-44f6-be74-72c71a64db34", "address": "fa:16:3e:ad:aa:5b", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd8215e-37", "ovs_interfaceid": "ddd8215e-3724-44f6-be74-72c71a64db34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "526f62a9-7cd1-4340-8c1a-7c97514555c3", "address": "fa:16:3e:9e:2d:14", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap526f62a9-7c", "ovs_interfaceid": "526f62a9-7cd1-4340-8c1a-7c97514555c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "123df424-6ed2-46af-8841-b8913863bbff", "address": "fa:16:3e:c6:57:28", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123df424-6e", "ovs_interfaceid": "123df424-6ed2-46af-8841-b8913863bbff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d87a756b-eaae-4f37-8617-80e0bde7e645", "address": "fa:16:3e:e6:74:c2", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87a756b-ea", "ovs_interfaceid": "d87a756b-eaae-4f37-8617-80e0bde7e645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e07149b8-1bb8-4152-8a93-34bac5a39f44", "address": "fa:16:3e:22:ae:4e", "network": {"id": "4242a6b4-eb6b-4570-9a62-940f827d326d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388153480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape07149b8-1b", "ovs_interfaceid": "e07149b8-1bb8-4152-8a93-34bac5a39f44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58bc32a7-25f9-4a71-a78d-4727002c1ed0", "address": "fa:16:3e:cc:67:43", "network": {"id": "4242a6b4-eb6b-4570-9a62-940f827d326d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388153480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bc32a7-25", "ovs_interfaceid": "58bc32a7-25f9-4a71-a78d-4727002c1ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 03 01:08:50.654079 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lazy-loading 'flavor' on Instance uuid 6eefbe1c-468b-4294-9f24-7cc661bb3df2 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:50.656853 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Start _get_guest_xml network_info=[{"id": "8c74fc9e-d0c3-4b2a-ba57-ec57f90176dd", "address": "fa:16:3e:14:c0:33", "network": {"id": "97df5886-6ee8-4735-9015-26059b0f0a2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-881377593-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c74fc9e-d0", "ovs_interfaceid": "8c74fc9e-d0c3-4b2a-ba57-ec57f90176dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddd8215e-3724-44f6-be74-72c71a64db34", "address": "fa:16:3e:ad:aa:5b", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd8215e-37", "ovs_interfaceid": "ddd8215e-3724-44f6-be74-72c71a64db34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "526f62a9-7cd1-4340-8c1a-7c97514555c3", "address": "fa:16:3e:9e:2d:14", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap526f62a9-7c", "ovs_interfaceid": "526f62a9-7cd1-4340-8c1a-7c97514555c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "123df424-6ed2-46af-8841-b8913863bbff", "address": "fa:16:3e:c6:57:28", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123df424-6e", "ovs_interfaceid": "123df424-6ed2-46af-8841-b8913863bbff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d87a756b-eaae-4f37-8617-80e0bde7e645", "address": "fa:16:3e:e6:74:c2", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87a756b-ea", "ovs_interfaceid": "d87a756b-eaae-4f37-8617-80e0bde7e645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e07149b8-1bb8-4152-8a93-34bac5a39f44", "address": "fa:16:3e:22:ae:4e", "network": {"id": "4242a6b4-eb6b-4570-9a62-940f827d326d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388153480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape07149b8-1b", "ovs_interfaceid": "e07149b8-1bb8-4152-8a93-34bac5a39f44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58bc32a7-25f9-4a71-a78d-4727002c1ed0", "address": "fa:16:3e:cc:67:43", "network": {"id": "4242a6b4-eb6b-4570-9a62-940f827d326d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388153480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bc32a7-25", "ovs_interfaceid": "58bc32a7-25f9-4a71-a78d-4727002c1ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'c19c4674-2b6b-48be-b09c-0c8a11e9ce03', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14', 'iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45521e37-c85f-4d22-92dd-4c870fc9ff14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c861dfe4-7a78-4098-aa35-8d1f948edb4d', 'attached_at': '', 'detached_at': '', 'volume_id': '45521e37-c85f-4d22-92dd-4c870fc9ff14', 'serial': '45521e37-c85f-4d22-92dd-4c870fc9ff14'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '7c327907-cf9f-4b41-aaa3-fbf1931f930d', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2684365a-7228-4033-ba26-4edcdba3d417', 'iqn.2023-03.storpool.com:os--volume-2684365a-7228-4033-ba26-4edcdba3d417'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2684365a-7228-4033-ba26-4edcdba3d417', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2684365a-7228-4033-ba26-4edcdba3d417', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c861dfe4-7a78-4098-aa35-8d1f948edb4d', 'attached_at': '', 'detached_at': '', 'volume_id': '2684365a-7228-4033-ba26-4edcdba3d417', 'serial': '2684365a-7228-4033-ba26-4edcdba3d417'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '7d5322fd-ea00-40d7-8ed2-33871a4edc88', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce6b2375-c8c8-4aad-8827-dc52065638b8', 'iqn.2023-03.storpool.com:os--volume-ce6b2375-c8c8-4aad-8827-dc52065638b8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce6b2375-c8c8-4aad-8827-dc52065638b8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce6b2375-c8c8-4aad-8827-dc52065638b8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c861dfe4-7a78-4098-aa35-8d1f948edb4d', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce6b2375-c8c8-4aad-8827-dc52065638b8', 'serial': 'ce6b2375-c8c8-4aad-8827-dc52065638b8'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}} Jun 03 01:08:50.659107 np0000002000 nova-compute[98288]: WARNING nova.virt.libvirt.driver [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 03 01:08:50.660259 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='19d2b67c-d393-46ed-9253-ee20621e0ff0', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1921582050', uuid='c861dfe4-7a78-4098-aa35-8d1f948edb4d'), owner=OwnerMeta(userid='392b5174633d48c4966e5e980fdbcd63', username='tempest-TaggedBootDevicesTest_v242-2044348565-project-member', projectid='8cfb864a5c5c4e1e82b50d1ab82711aa', projectname='tempest-TaggedBootDevicesTest_v242-2044348565'), image=ImageMeta(id='19d2b67c-d393-46ed-9253-ee20621e0ff0', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8c74fc9e-d0c3-4b2a-ba57-ec57f90176dd", "address": "fa:16:3e:14:c0:33", "network": {"id": "97df5886-6ee8-4735-9015-26059b0f0a2e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-881377593-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c74fc9e-d0", "ovs_interfaceid": "8c74fc9e-d0c3-4b2a-ba57-ec57f90176dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ddd8215e-3724-44f6-be74-72c71a64db34", "address": "fa:16:3e:ad:aa:5b", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapddd8215e-37", "ovs_interfaceid": "ddd8215e-3724-44f6-be74-72c71a64db34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "526f62a9-7cd1-4340-8c1a-7c97514555c3", "address": "fa:16:3e:9e:2d:14", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap526f62a9-7c", "ovs_interfaceid": "526f62a9-7cd1-4340-8c1a-7c97514555c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "123df424-6ed2-46af-8841-b8913863bbff", "address": "fa:16:3e:c6:57:28", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap123df424-6e", "ovs_interfaceid": "123df424-6ed2-46af-8841-b8913863bbff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d87a756b-eaae-4f37-8617-80e0bde7e645", "address": "fa:16:3e:e6:74:c2", "network": {"id": "953cfd79-d2b4-4e2f-8487-7335c937b8c3", "bridge": "br-int", "label": "tempest-device-tagging-net1-141036995", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd87a756b-ea", "ovs_interfaceid": "d87a756b-eaae-4f37-8617-80e0bde7e645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e07149b8-1bb8-4152-8a93-34bac5a39f44", "address": "fa:16:3e:22:ae:4e", "network": {"id": "4242a6b4-eb6b-4570-9a62-940f827d326d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388153480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape07149b8-1b", "ovs_interfaceid": "e07149b8-1bb8-4152-8a93-34bac5a39f44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58bc32a7-25f9-4a71-a78d-4727002c1ed0", "address": "fa:16:3e:cc:67:43", "network": {"id": "4242a6b4-eb6b-4570-9a62-940f827d326d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388153480", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8cfb864a5c5c4e1e82b50d1ab82711aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap58bc32a7-25", "ovs_interfaceid": "58bc32a7-25f9-4a71-a78d-4727002c1ed0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1780448930.659787) {{(pid=98288) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 03 01:08:50.661767 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V1... {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 03 01:08:50.661911 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] CPU controller missing on host. {{(pid=98288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 03 01:08:50.663689 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Searching host: 'np0000002000' for CPU controller through CGroups V2... {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 03 01:08:50.663841 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.host [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] CPU controller found on host. {{(pid=98288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 03 01:08:50.664553 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}} Jun 03 01:08:50.664825 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-03T01:02:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-03T01:02:26Z,direct_url=,disk_format='qcow2',id=19d2b67c-d393-46ed-9253-ee20621e0ff0,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='f781b18b0fe740ec8cfb697154d73d96',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-03T01:02:29Z,virtual_size=,visibility=), allow threads: True {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 03 01:08:50.664946 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Flavor limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 03 01:08:50.665087 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Image limits 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 03 01:08:50.665141 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Flavor pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 03 01:08:50.665293 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Image pref 0:0:0 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 03 01:08:50.665293 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 03 01:08:50.665434 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 03 01:08:50.665570 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 03 01:08:50.665659 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Got 1 possible topologies {{(pid=98288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 03 01:08:50.665756 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 03 01:08:50.665857 np0000002000 nova-compute[98288]: DEBUG nova.virt.hardware [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 03 01:08:50.675400 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] [instance: c861dfe4-7a78-4098-aa35-8d1f948edb4d] Calling os-brick to attach iSCSI Volume {{(pid=98288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 03 01:08:50.675647 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14', 'iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45521e37-c85f-4d22-92dd-4c870fc9ff14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 03 01:08:50.675771 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:50.676362 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:50.676362 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14', 'iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45521e37-c85f-4d22-92dd-4c870fc9ff14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 03 01:08:50.688337 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:50.688952 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 03 01:08:50.689475 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:50.693510 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:08:50.693510 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 03 01:08:50.693510 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:08:50.704085 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:08:50.704085 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:50.712321 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 03 01:08:50.712321 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:50.718628 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14] added Jun 03 01:08:50.718628 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:08:50.718628 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:50.718628 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:50.718628 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:50.718628 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:50.718628 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:50.718785 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:08:50.718987 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:08:50.719119 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:08:50.724312 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14] added Jun 03 01:08:50.724312 np0000002000 nova-compute[98288]: stderr=iscsiadm: Config file line 363 does not have value Jun 03 01:08:50.724312 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:50.724312 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:50.724312 np0000002000 nova-compute[98288]: iscsiadm: Config file line 363 does not have value Jun 03 01:08:50.724312 np0000002000 nova-compute[98288]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 03 01:08:50.724312 np0000002000 nova-compute[98288]: {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:50.724312 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98288) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 03 01:08:50.724627 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 03 01:08:50.724627 np0000002000 nova-compute[98288]: DEBUG os_brick.utils [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98288) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 03 01:08:50.850421 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.885311 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:50.898729 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:50.957260 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] End _get_guest_xml xml= Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: instance-00000019 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 196608 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: tempest-AttachVolumeNegativeTest-server-366584080 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 2026-06-03 01:08:50 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 192 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: True Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: bare Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: tempest-AttachVolumeNegativeTest-1145310491-project-member Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: tempest-AttachVolumeNegativeTest-1145310491 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: hvm Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 128 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: /dev/urandom Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: Jun 03 01:08:51.120345 np0000002000 nova-compute[98288]: {{(pid=98288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}} Jun 03 01:08:51.121989 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Preparing to wait for external event network-vif-plugged-9b52384d-693c-4b57-b5c0-491e9330f342 {{(pid=98288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 03 01:08:51.121989 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Acquiring lock "9b3ac820-6802-4d93-abe4-e6f8ad2d7f55-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:51.121989 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "9b3ac820-6802-4d93-abe4-e6f8ad2d7f55-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:51.121989 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Lock "9b3ac820-6802-4d93-abe4-e6f8ad2d7f55-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:51.121989 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-03T01:08:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-366584080',display_name='tempest-AttachVolumeNegativeTest-server-366584080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-attachvolumenegativetest-server-366584080',id=25,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTrhBORLalF0nS+++pzi3GBYihYPxGyuB0T7CV6sTY9pgP8RUyZoz8vWEagn2Ub2QFSgwDbdhHLFgeUfSp9kQBR5gMr+eT9cuHcxUXJ18rc/RXoc1rLco2kITRyvnXX7g==',key_name='tempest-keypair-85402758',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000002000',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88e01380196548bbbe8f5f9e9147494b',ramdisk_id='',reservation_id='r-uiab0ptf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1145310491',owner_user_name='tempest-AttachVolumeNegativeTest-1145310491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-03T01:08:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4586ad9e4c304b0fa9a960267667ac64',uuid=9b3ac820-6802-4d93-abe4-e6f8ad2d7f55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b52384d-693c-4b57-b5c0-491e9330f342", "address": "fa:16:3e:65:02:8d", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b52384d-69", "ovs_interfaceid": "9b52384d-693c-4b57-b5c0-491e9330f342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 03 01:08:51.123844 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converting VIF {"id": "9b52384d-693c-4b57-b5c0-491e9330f342", "address": "fa:16:3e:65:02:8d", "network": {"id": "91fb03fe-6df1-4518-8ef8-3dfa021722a8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1470366605-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "88e01380196548bbbe8f5f9e9147494b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b52384d-69", "ovs_interfaceid": "9b52384d-693c-4b57-b5c0-491e9330f342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:51.124632 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:02:8d,bridge_name='br-int',has_traffic_filtering=True,id=9b52384d-693c-4b57-b5c0-491e9330f342,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b52384d-69') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:51.125026 np0000002000 nova-compute[98288]: DEBUG os_vif [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:02:8d,bridge_name='br-int',has_traffic_filtering=True,id=9b52384d-693c-4b57-b5c0-491e9330f342,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b52384d-69') {{(pid=98288) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 03 01:08:51.125387 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:51.125629 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:51.125853 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 03 01:08:51.126791 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:51.126934 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b051fc8-af1a-578e-9d99-1b39670d873d', '_type': 'linux-noop'}}, row=False) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:51.142187 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:51.147664 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 13 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:51.147851 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b52384d-69, may_exist=True, interface_attrs={}) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:51.148184 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b52384d-69, col_values=(('qos', UUID('a855aa7d-ade4-4fe5-abcd-ed1d77567f10')),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:51.148358 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b52384d-69, col_values=(('external_ids', {'iface-id': '9b52384d-693c-4b57-b5c0-491e9330f342', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:02:8d', 'vm-uuid': '9b3ac820-6802-4d93-abe4-e6f8ad2d7f55'}),), if_exists=True) {{(pid=98288) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 03 01:08:51.150327 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 03 01:08:51.156881 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:51.157696 np0000002000 nova-compute[98288]: INFO os_vif [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:02:8d,bridge_name='br-int',has_traffic_filtering=True,id=9b52384d-693c-4b57-b5c0-491e9330f342,network=Network(91fb03fe-6df1-4518-8ef8-3dfa021722a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b52384d-69') Jun 03 01:08:51.231393 np0000002000 nova-compute[98288]: WARNING neutronclient.v2_0.client [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 03 01:08:51.233042 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:51.239670 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:51.242768 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:51.272852 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:51.279845 np0000002000 nova-compute[98288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98288) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 03 01:08:51.426047 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Updated VIF entry in instance network info cache for port 49f6412d-4366-42e3-a2f7-19a20cc8c032. {{(pid=98288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 03 01:08:51.426525 np0000002000 nova-compute[98288]: DEBUG nova.network.neutron [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Updating instance_info_cache with network_info: [{"id": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "address": "fa:16:3e:2e:c4:5e", "network": {"id": "6866ea75-ee2b-4dbc-87c7-4617f6e4222d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1478858210-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2a3f095839e4616a6f1efd27c8d5e7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49f6412d-43", "ovs_interfaceid": "49f6412d-4366-42e3-a2f7-19a20cc8c032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 03 01:08:51.473550 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Started> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:51.473772 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 03 01:08:51.475040 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] VM Started (Lifecycle Event) Jun 03 01:08:51.481698 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Guest created on hypervisor {{(pid=98288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}} Jun 03 01:08:51.489615 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [-] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Instance spawned successfully. Jun 03 01:08:51.490575 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 03 01:08:51.649032 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-63b74fb1-05cc-4919-987b-c52e8dfb65ec req-26bec592-dd85-4072-9ef4-0a20d742c3ce service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received event network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:51.649176 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-63b74fb1-05cc-4919-987b-c52e8dfb65ec req-26bec592-dd85-4072-9ef4-0a20d742c3ce service nova] Acquiring lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:51.650065 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-63b74fb1-05cc-4919-987b-c52e8dfb65ec req-26bec592-dd85-4072-9ef4-0a20d742c3ce service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:51.650065 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-63b74fb1-05cc-4919-987b-c52e8dfb65ec req-26bec592-dd85-4072-9ef4-0a20d742c3ce service nova] Lock "2ae68109-fd4c-4cb8-ac62-f49800f5ec34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:51.650065 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-63b74fb1-05cc-4919-987b-c52e8dfb65ec req-26bec592-dd85-4072-9ef4-0a20d742c3ce service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] No waiting events found dispatching network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:51.650065 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-63b74fb1-05cc-4919-987b-c52e8dfb65ec req-26bec592-dd85-4072-9ef4-0a20d742c3ce service nova] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Received unexpected event network-vif-unplugged-49f6412d-4366-42e3-a2f7-19a20cc8c032 for instance with vm_state rescued and task_state unrescuing. Jun 03 01:08:51.719597 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 03 01:08:51.725453 np0000002000 nova-compute[98288]: INFO os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.40.100 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:08:51.734484 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.name = iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.tpgt = -1 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.startup = manual Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.leading_login = No Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.iscsi_ifacename = default Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.net_ifacename = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.ipaddress = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.prefix_len = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.hwaddress = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.transport_name = tcp Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.initiatorname = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.state = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.vlan_id = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.vlan_priority = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.vlan_state = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.iface_num = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.mtu = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.port = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.bootproto = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.subnet_mask = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.gateway = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id_state = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.dhcp_alt_client_id = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.dhcp_dns = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.dhcp_learn_iqn = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.dhcp_req_vendor_id_state = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id_state = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.dhcp_vendor_id = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.dhcp_slp_da = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.fragmentation = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.gratuitous_arp = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.incoming_forwarding = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.tos_state = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.tos = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.ttl = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.delayed_ack = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.tcp_nagle = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.tcp_wsf_state = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.tcp_wsf = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.tcp_timer_scale = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.tcp_timestamp = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.redirect = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.def_task_mgmt_timeout = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.header_digest = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.data_digest = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.immediate_data = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.initial_r2t = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.data_seq_inorder = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.data_pdu_inorder = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.erl = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.max_receive_data_len = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.first_burst_len = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.max_outstanding_r2t = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.max_burst_len = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.chap_auth = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.bidi_chap = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.strict_login_compliance = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.discovery_auth = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: iface.discovery_logout = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.discovery_address = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.discovery_port = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.discovery_type = fw Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.initial_cmdsn = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.initial_login_retry_max = 8 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.xmit_thread_priority = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.cmds_max = 128 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.queue_depth = 32 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.nr_sessions = 1 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.auth.authmethod = None Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.auth.username = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.auth.password = *** Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.auth.username_in = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.auth.password_in = Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.auth.chap_algs = SHA256 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.timeo.replacement_timeout = 120 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.err_timeo.abort_timeout = 15 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.err_timeo.lu_reset_timeout = 30 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.err_timeo.host_reset_timeout = 60 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.iscsi.FastAbort = Yes Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.iscsi.InitialR2T = No Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.iscsi.ImmediateData = Yes Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.iscsi.FirstBurstLength = 262144 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.iscsi.MaxBurstLength = 16776192 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Retain = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.iscsi.DefaultTime2Wait = 2 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.iscsi.MaxConnections = 1 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.iscsi.ERL = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.scan = auto Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.session.reopen_max = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].address = 192.168.50.100 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].port = 3260 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].startup = manual Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].tcp.window_size = 524288 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].tcp.type_of_service = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].timeo.logout_timeout = 15 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].timeo.login_timeout = 15 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].timeo.auth_timeout = 45 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_interval = 5 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].timeo.noop_out_timeout = 5 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].iscsi.HeaderDigest = None Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].iscsi.DataDigest = None Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].iscsi.IFMarker = No Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: node.conn[0].iscsi.OFMarker = No Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: # END RECORD Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-ec7acc3a-25db-4be4-aaf5-d29bb725f217 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Acquiring lock "interface-6eefbe1c-468b-4294-9f24-7cc661bb3df2-41fd9876-5f59-4e58-b392-4a1482ee9e7e" by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:51.741974 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-ec7acc3a-25db-4be4-aaf5-d29bb725f217 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "interface-6eefbe1c-468b-4294-9f24-7cc661bb3df2-41fd9876-5f59-4e58-b392-4a1482ee9e7e" acquired by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:51.748488 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:51.757115 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:51.762364 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.762364 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.762364 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.762364 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.762364 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.762364 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.762364 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:51.762600 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.762600 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.762600 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.762600 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.762600 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.762600 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.762600 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:51.778189 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.778189 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.778189 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.778189 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.778189 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.778189 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.778189 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:51.778510 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.778510 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.778510 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.778510 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.778510 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.778510 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.778510 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:51.803107 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-6ca87bc1-73e9-404e-a5a5-96a596ee4726 tempest-ServerStableDeviceRescueTest-945622888 tempest-ServerStableDeviceRescueTest-945622888-project-member] [instance: 2ae68109-fd4c-4cb8-ac62-f49800f5ec34] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:51.805643 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14, portal: 192.168.40.100,3260] Jun 03 01:08:51.805643 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14, portal: 192.168.40.100,3260] successful. Jun 03 01:08:51.805643 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:51.822563 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:51.831382 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14, portal: 192.168.50.100,3260] Jun 03 01:08:51.831382 np0000002000 nova-compute[98288]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14, portal: 192.168.50.100,3260] successful. Jun 03 01:08:51.831382 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:51.840974 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.840974 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.840974 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.840974 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.840974 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.840974 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.840974 np0000002000 nova-compute[98288]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14 (non-flash) Jun 03 01:08:51.840974 np0000002000 nova-compute[98288]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14 (non-flash) Jun 03 01:08:51.840974 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:51.841402 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.841402 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.841402 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.841402 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.841402 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.841402 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.841402 np0000002000 nova-compute[98288]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14 (non-flash) Jun 03 01:08:51.841402 np0000002000 nova-compute[98288]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14 (non-flash) Jun 03 01:08:51.841402 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:51.841402 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:51.841684 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Connected to 192.168.40.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:08:51.842222 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] HCTL ('11', '-', '-', 0) found on session 50 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:08:51.842376 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:08:51.846045 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98288) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 03 01:08:51.858270 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Searching for a device in session 50 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:08:51.858270 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45521e37-c85f-4d22-92dd-4c870fc9ff14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14 (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14 (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8692f17c-5ea5-47f1-8c58-4ae3c5185693 (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-64e3bce8-72d3-40a5-bd26-63d9f31890d5 (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [48] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75b12252-4c73-488f-beaa-23a5c0dd078c (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14 (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14 (non-flash) Jun 03 01:08:51.868146 np0000002000 nova-compute[98288]: stderr= {{(pid=98288) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 03 01:08:51.868742 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.base [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 03 01:08:51.868742 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Connected to 192.168.50.100:3260 {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 03 01:08:51.869402 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] HCTL ('12', '-', '-', 0) found on session 51 with lun 0 {{(pid=98288) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 03 01:08:51.869598 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98288) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 03 01:08:51.885807 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.linuxscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Searching for a device in session 51 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98288) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 03 01:08:51.885972 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45521e37-c85f-4d22-92dd-4c870fc9ff14', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '45521e37-c85f-4d22-92dd-4c870fc9ff14', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98288) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 03 01:08:51.930854 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-106a0c23-fa43-42a8-aeaf-7be441e276e5 req-1571ec2c-b107-4a2c-b71b-38dcbaf58e86 service nova] Releasing lock "refresh_cache-2ae68109-fd4c-4cb8-ac62-f49800f5ec34" {{(pid=98288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 03 01:08:51.935619 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:51.935619 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:51.935619 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:51.935619 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-e1abb327-4504-424b-a3bc-c0b55b14c16e tempest-VolumesSnapshotTestJSON-1626537970 tempest-VolumesSnapshotTestJSON-1626537970-project-member] No VIF found with MAC fa:16:3e:fb:20:4b, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:08:51.978633 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:51.980869 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98288) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 03 01:08:52.002155 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Found default for hw_cdrom_bus of ide {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:52.002155 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Found default for hw_disk_bus of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:52.002588 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Found default for hw_input_bus of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:52.002876 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Found default for hw_pointer_model of None {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:52.005487 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Found default for hw_video_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:52.009218 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Found default for hw_vif_model of virtio {{(pid=98288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 03 01:08:52.170994 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-80ab16f2-80c0-40ac-b2a0-6daa4bb7bdbd tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lock "6eefbe1c-468b-4294-9f24-7cc661bb3df2" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 8.900s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:52.193822 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6e6c60f-d026-4ce2-a2f1-7a0a811131c8 tempest-ImageDependencyTests-432194443 tempest-ImageDependencyTests-432194443-project-member] Acquiring lock "bcda7737-ed9f-4a0f-aabb-1dc607f143a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:52.194116 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [None req-c6e6c60f-d026-4ce2-a2f1-7a0a811131c8 tempest-ImageDependencyTests-432194443 tempest-ImageDependencyTests-432194443-project-member] Lock "bcda7737-ed9f-4a0f-aabb-1dc607f143a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:52.247010 np0000002000 nova-compute[98288]: DEBUG nova.objects.instance [None req-ec7acc3a-25db-4be4-aaf5-d29bb725f217 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Lazy-loading 'flavor' on Instance uuid 6eefbe1c-468b-4294-9f24-7cc661bb3df2 {{(pid=98288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 03 01:08:52.457302 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-573f82c3-f501-4d76-9727-f03245e42a3b req-5c8fbd61-d92d-4213-a9ef-b4c2cea80706 service nova] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Received event network-vif-plugged-7fa21f7f-d12f-4b73-b581-0c992a97a8ab {{(pid=98288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 03 01:08:52.457552 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-573f82c3-f501-4d76-9727-f03245e42a3b req-5c8fbd61-d92d-4213-a9ef-b4c2cea80706 service nova] Acquiring lock "f105ef75-cffa-4f4d-a782-a5470dd30f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 03 01:08:52.458002 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-573f82c3-f501-4d76-9727-f03245e42a3b req-5c8fbd61-d92d-4213-a9ef-b4c2cea80706 service nova] Lock "f105ef75-cffa-4f4d-a782-a5470dd30f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 03 01:08:52.458130 np0000002000 nova-compute[98288]: DEBUG oslo_concurrency.lockutils [req-573f82c3-f501-4d76-9727-f03245e42a3b req-5c8fbd61-d92d-4213-a9ef-b4c2cea80706 service nova] Lock "f105ef75-cffa-4f4d-a782-a5470dd30f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98288) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 03 01:08:52.458275 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [req-573f82c3-f501-4d76-9727-f03245e42a3b req-5c8fbd61-d92d-4213-a9ef-b4c2cea80706 service nova] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] No waiting events found dispatching network-vif-plugged-7fa21f7f-d12f-4b73-b581-0c992a97a8ab {{(pid=98288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 03 01:08:52.458383 np0000002000 nova-compute[98288]: WARNING nova.compute.manager [req-573f82c3-f501-4d76-9727-f03245e42a3b req-5c8fbd61-d92d-4213-a9ef-b4c2cea80706 service nova] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Received unexpected event network-vif-plugged-7fa21f7f-d12f-4b73-b581-0c992a97a8ab for instance with vm_state building and task_state spawning. Jun 03 01:08:52.485259 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] During sync_power_state the instance has a pending task (spawning). Skip. Jun 03 01:08:52.485594 np0000002000 nova-compute[98288]: DEBUG nova.virt.driver [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] Emitting event Paused> {{(pid=98288) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 03 01:08:52.485769 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-d5908515-21ee-41af-afc2-e51f6f6ddb96 None None] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] VM Paused (Lifecycle Event) Jun 03 01:08:52.515170 np0000002000 nova-compute[98288]: INFO nova.compute.manager [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Took 7.01 seconds to spawn the instance on the hypervisor. Jun 03 01:08:52.515423 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-f4c9ca9b-a139-4de0-b4f0-e3db2b0963dd tempest-AttachVolumeMultiAttachTest-619856118 tempest-AttachVolumeMultiAttachTest-619856118-project-member] [instance: f105ef75-cffa-4f4d-a782-a5470dd30f0a] Checking state {{(pid=98288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 03 01:08:52.683939 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] No BDM found with device name vda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:52.687467 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] No BDM found with device name hda, not building metadata. {{(pid=98288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}} Jun 03 01:08:52.687467 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] No VIF found with MAC fa:16:3e:65:02:8d, not building metadata {{(pid=98288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}} Jun 03 01:08:52.687467 np0000002000 nova-compute[98288]: INFO nova.virt.libvirt.driver [None req-7847c24f-c0dc-4a6f-847b-8d7725a90817 tempest-AttachVolumeNegativeTest-1145310491 tempest-AttachVolumeNegativeTest-1145310491-project-member] [instance: 9b3ac820-6802-4d93-abe4-e6f8ad2d7f55] Using config drive Jun 03 01:08:52.690609 np0000002000 nova-compute[98288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4307645b-fe74-4980-aced-d23e7c242ac1 tempest-TaggedBootDevicesTest_v242-2044348565 tempest-TaggedBootDevicesTest_v242-2044348565-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98288) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 03 01:08:52.696777 np0000002000 nova-compute[98288]: DEBUG nova.compute.manager [None req-c6e6c60f-d026-4ce2-a2f1-7a0a811131c8 tempest-ImageDependencyTests-432194443 tempest-ImageDependencyTests-432194443-project-member] [instance: bcda7737-ed9f-4a0f-aabb-1dc607f143a1] Starting instance... {{(pid=98288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 03 01:08:52.757388 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.vif [None req-ec7acc3a-25db-4be4-aaf5-d29bb725f217 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-03T01:07:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-565619882',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000002000',hostname='tempest-device-tagging-server-565619882',id=19,image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbZ9pKZxlPAaSnxNpNutFnQbBi3kuyPB49DYd+gGlDINebjgMkgajEvEz+1OvuZiqu1lqqUbr7htvJLcQVd34/M9wOa/5NMz3tTbdndj/0vW5a6CvOsqaq3g7g+PdObvA==',key_name='tempest-keypair-1816886568',keypairs=,launch_index=0,launched_at=2026-06-03T01:07:44Z,launched_on='np0000002000',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000002000',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='f52af3a46de7498c8225030529c1d868',ramdisk_id='',reservation_id='r-55wspc0r',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='19d2b67c-d393-46ed-9253-ee20621e0ff0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1125506206',owner_user_name='tempest-TaggedAttachmentsTest-1125506206-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-03T01:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8092b0179794edf9ce6d802adc8cc8f',uuid=6eefbe1c-468b-4294-9f24-7cc661bb3df2,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "address": "fa:16:3e:a2:1a:e1", "network": {"id": "7b4bae06-a890-4930-b64d-de017282f84d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1628608206", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd9876-5f", "ovs_interfaceid": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 03 01:08:52.757617 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-ec7acc3a-25db-4be4-aaf5-d29bb725f217 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Converting VIF {"id": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "address": "fa:16:3e:a2:1a:e1", "network": {"id": "7b4bae06-a890-4930-b64d-de017282f84d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1628608206", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f52af3a46de7498c8225030529c1d868", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41fd9876-5f", "ovs_interfaceid": "41fd9876-5f59-4e58-b392-4a1482ee9e7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 03 01:08:52.758099 np0000002000 nova-compute[98288]: DEBUG nova.network.os_vif_util [None req-ec7acc3a-25db-4be4-aaf5-d29bb725f217 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:1a:e1,bridge_name='br-int',has_traffic_filtering=True,id=41fd9876-5f59-4e58-b392-4a1482ee9e7e,network=Network(7b4bae06-a890-4930-b64d-de017282f84d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41fd9876-5f') {{(pid=98288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 03 01:08:52.762048 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-ec7acc3a-25db-4be4-aaf5-d29bb725f217 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] looking for interface given config: {{(pid=98288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 03 01:08:52.763298 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-ec7acc3a-25db-4be4-aaf5-d29bb725f217 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] looking for interface given config: {{(pid=98288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 03 01:08:52.764572 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.driver [None req-ec7acc3a-25db-4be4-aaf5-d29bb725f217 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] Attempting to detach device tap41fd9876-5f from instance 6eefbe1c-468b-4294-9f24-7cc661bb3df2 from the persistent domain config. {{(pid=98288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}} Jun 03 01:08:52.764738 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-ec7acc3a-25db-4be4-aaf5-d29bb725f217 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] detach device xml: Jun 03 01:08:52.764738 np0000002000 nova-compute[98288]: Jun 03 01:08:52.764738 np0000002000 nova-compute[98288]: Jun 03 01:08:52.764738 np0000002000 nova-compute[98288]: Jun 03 01:08:52.764738 np0000002000 nova-compute[98288]: Jun 03 01:08:52.764738 np0000002000 nova-compute[98288]: Jun 03 01:08:52.764738 np0000002000 nova-compute[98288]: Jun 03 01:08:52.764738 np0000002000 nova-compute[98288]: {{(pid=98288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 03 01:08:52.768581 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-ec7acc3a-25db-4be4-aaf5-d29bb725f217 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] looking for interface given config: {{(pid=98288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: DEBUG nova.virt.libvirt.guest [None req-ec7acc3a-25db-4be4-aaf5-d29bb725f217 tempest-TaggedAttachmentsTest-1125506206 tempest-TaggedAttachmentsTest-1125506206-project-member] interface for config: not found in domain: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: instance-00000013 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 6eefbe1c-468b-4294-9f24-7cc661bb3df2 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: tempest-device-tagging-server-565619882 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 2026-06-03 01:08:29 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 192 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: True Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: bare Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: qcow2 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 0 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: ide Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: pc Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: virtio Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: tempest-TaggedAttachmentsTest-1125506206-project-member Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: tempest-TaggedAttachmentsTest-1125506206 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 196608 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 196608 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 1 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: /machine Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: OpenStack Foundation Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: OpenStack Nova Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 33.1.0 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 6eefbe1c-468b-4294-9f24-7cc661bb3df2 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 6eefbe1c-468b-4294-9f24-7cc661bb3df2 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Virtual Machine Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: hvm Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: 131072 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Nehalem Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: destroy Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: restart Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: destroy Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: /usr/bin/qemu-system-x86_64 Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]:
Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]:
Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]:
Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]:
Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]:
Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: Jun 03 01:08:52.770477 np0000002000 nova-compute[98288]: